-- Logs begin at Fri 2022-01-14 09:06:30 UTC, end at Fri 2022-01-14 10:02:45 UTC. -- Jan 14 09:36:29.622480 dv-cinder-821602-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 14 09:36:29.632565 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 14 09:36:29 2022] *** Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: nodename: dv-cinder-821602-11-iscsi Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: machine: x86_64 Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: clock source: unix Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: pcre jit disabled Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: detected number of CPU cores: 4 Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: current working directory: / Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: detected binary path: /usr/bin/uwsgi-core Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: your processes number limit is 47680 Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: your memory page size is 4096 bytes Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: detected max file descriptor number: 2048 Jan 14 09:36:29.634520 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: lock engine: pthread robust mutexes Jan 14 09:36:29.635645 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: thunder lock: enabled Jan 14 09:36:29.635645 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 14 09:36:29.635645 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 14 09:36:29.687411 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: Python main interpreter initialized at 0x5582ead029c0 Jan 14 09:36:29.687411 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: python threads support enabled Jan 14 09:36:29.687411 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: your server socket listen backlog is limited to 100 connections Jan 14 09:36:29.687411 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: your mercy for graceful operations on workers is 90 seconds Jan 14 09:36:29.687853 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: mapped 403077 bytes (393 KB) for 2 cores Jan 14 09:36:29.687853 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: *** Operational MODE: preforking *** Jan 14 09:36:29.688155 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: *** uWSGI is running in multiple interpreter mode *** Jan 14 09:36:29.688155 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: spawned uWSGI master process (pid: 113640) Jan 14 09:36:29.688373 dv-cinder-821602-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 14 09:36:29.689475 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: spawned uWSGI worker 1 (pid: 113641, cores: 1) Jan 14 09:36:29.689475 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: spawned uWSGI worker 2 (pid: 113642, cores: 1) Jan 14 09:36:29.689475 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 14 09:36:31.621636 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:36:31.621636 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: from cryptography.utils import int_from_bytes Jan 14 09:36:31.622565 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:36:31.622565 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: from cryptography.utils import int_from_bytes Jan 14 09:36:31.624324 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:36:31.624324 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: from cryptography.utils import int_from_bytes Jan 14 09:36:31.624811 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:36:31.624811 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: from cryptography.utils import int_from_bytes Jan 14 09:36:34.191560 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 14 09:36:34.192255 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 14 09:36:34.192355 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 14 09:36:34.192684 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 14 09:36:34.192946 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 14 09:36:34.193339 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.193673 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.194267 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.194616 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.194953 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.195271 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.195599 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.195922 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.196256 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.196521 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.196844 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.197174 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-11-iscsi {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.197307 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 14 09:36:34.197711 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.197792 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 14 09:36:34.197884 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.198088 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 14 09:36:34.198181 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.198438 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.198527 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 14 09:36:34.198729 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 14 09:36:34.198814 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.199067 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.199151 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.199381 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.199482 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.199739 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.199891 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.200063 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.200341 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.200463 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.200689 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.200815 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.200971 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201093 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201318 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201456 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201636 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201733 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201898 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.201983 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.202219 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.202377 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.202576 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-11-iscsi {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.202670 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.202905 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.203043 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.203216 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.203316 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.203570 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.203730 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-11-iscsi {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.203899 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.204060 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.204210 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.204380 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.204535 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.204701 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.204830 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.205136 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.205354 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.205466 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.205668 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.205769 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.205977 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.206064 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.206293 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.206419 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.206664 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.206758 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.206982 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.207082 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.207295 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.207384 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.207616 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.207733 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.207927 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208034 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208248 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208345 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208556 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208643 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208867 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.208957 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-11-iscsi {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.209195 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.209295 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.209507 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.209598 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.209817 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.209916 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.210072 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.210284 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.210410 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.210641 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.210732 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.210952 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211053 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211278 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211368 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211602 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211704 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211907 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.211995 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.212174 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.212267 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.212505 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.212610 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.212820 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.212910 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.213136 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.213227 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.213437 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.213533 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.213748 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.213837 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.214060 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.214157 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.214387 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.214491 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.214703 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.214792 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215009 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215097 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215256 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215343 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215566 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215657 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215894 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.215991 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.216216 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.216307 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.216541 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.216632 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.216796 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.216964 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217062 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217199 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217358 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217513 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217681 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217868 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.217994 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.218194 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.218303 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.218607 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.218708 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.219441 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.219589 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.219773 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.219860 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.220081 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.220176 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.220390 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.220476 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.220699 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.220791 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221017 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221112 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221338 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221424 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221659 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221746 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.221912 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222006 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222222 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222309 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222563 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222706 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222890 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.222979 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.223202 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.223288 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.223516 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.223601 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.223832 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.223927 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.224139 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.224225 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.224453 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.224538 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.224767 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.224854 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225079 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225165 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225399 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225537 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225706 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225789 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.225992 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226079 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226304 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226408 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226641 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226735 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226893 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.226978 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.227200 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.227298 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.227509 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.227595 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.227831 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.227925 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.228141 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.228239 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.228450 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.228535 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.228756 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.228850 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229056 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229159 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229364 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229455 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229672 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229802 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.229980 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.230080 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.230288 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.230419 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.230622 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.230706 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.230930 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231029 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231241 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231336 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231548 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231643 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231852 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.231949 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.232166 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.232251 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.232481 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.232575 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.232785 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.232871 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.233095 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.233181 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.233401 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.233493 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.233708 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.233794 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.234019 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.234115 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.234332 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.234479 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.235244 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.235341 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.235565 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.235660 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.235878 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.235981 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.236182 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.236273 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.236503 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.236591 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.236809 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.236897 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.237121 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.237211 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.237431 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.237526 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.237734 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.237822 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.238043 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.238134 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.238376 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.238479 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.238694 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.238798 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.239004 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.239101 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.239313 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.239411 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.239623 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.239721 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.239932 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.240022 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.240241 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.240338 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.240551 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.240650 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.240858 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.240955 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.241161 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.241250 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.241482 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.241572 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.241806 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.241896 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.242117 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.242206 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.242450 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.242542 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.242776 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.242866 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.243087 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:36:34.243182 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.243426 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.243517 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.243746 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.243835 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.244073 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.244163 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.244392 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.244482 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.244716 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.244806 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245045 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245143 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245366 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245464 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245679 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245790 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.245992 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.246086 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.246321 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.246431 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.246657 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.246747 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.246972 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.247148 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.247288 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.247395 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.247607 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.247704 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.247927 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248025 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248238 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248332 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248557 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248646 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248873 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.248973 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.249194 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.249292 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.249504 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.249601 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.249826 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.249944 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.250155 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.250285 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.250523 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.250627 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.250840 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.250937 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.251186 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.251274 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.251492 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.251578 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.251807 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.251894 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.252117 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.252205 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.252438 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.252531 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.252763 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.252857 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.253072 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.253156 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.253381 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.253475 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.253696 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.253784 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254009 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254095 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254327 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254511 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254662 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254757 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.254983 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.255077 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.255300 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.255400 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.255612 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.255699 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.255918 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.256018 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.256230 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.256338 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.256537 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.256631 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.256869 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257003 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257160 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257256 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257471 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257575 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257790 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.257876 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.258095 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.258189 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.258428 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.258518 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.258748 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.258843 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.259059 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.259146 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.259374 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.259468 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.259683 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.259770 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260001 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260088 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260319 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260418 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260626 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260711 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.260951 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261045 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261265 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261350 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261575 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261685 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261879 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.261966 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.262194 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.262279 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.262524 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.262622 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.262835 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.262921 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.263144 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.263229 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.263458 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.263559 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.263763 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.263855 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264071 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264160 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264381 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264481 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264687 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264773 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.264994 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.265087 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.265322 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.265420 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.265632 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.265717 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.265963 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.266047 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.266278 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.266403 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.266613 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.266717 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.266926 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267038 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267243 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267334 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267553 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267643 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267863 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.267953 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.268171 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.268262 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.268484 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.268574 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.268795 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.268893 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.269103 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.269198 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.269434 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.269576 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.269721 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.269859 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270023 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270112 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270368 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270462 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270680 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270781 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.270990 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.271080 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.271308 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.271396 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.271623 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.271724 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.271956 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272047 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272273 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272363 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272598 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272698 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272907 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.272998 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.273228 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.273326 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.273566 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.273672 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.273878 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.273972 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.274199 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.274286 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.274546 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.274636 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.274857 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.274980 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.275171 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.275263 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.275480 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.275566 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.275786 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.275872 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.276098 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.276190 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.276405 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.276494 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.276718 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.276841 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277027 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277139 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277347 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277445 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277653 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277746 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.277957 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.278051 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.278274 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.278379 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.278618 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.278703 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.278939 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279040 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279245 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279332 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279578 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279665 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279891 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.279985 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.280207 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.280294 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.280522 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.280620 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.280832 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.280933 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.281143 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.281236 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.281961 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.282061 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.282283 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.282411 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.282619 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.282707 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.282942 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283033 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283239 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283326 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283554 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283689 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283861 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.283946 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.284171 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.284264 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.284473 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.284559 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.284786 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.284928 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.285100 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.285188 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.285407 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.285500 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.285714 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.285809 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286028 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286112 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286369 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286457 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286686 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286788 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.286995 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.287092 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.287309 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.287453 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.287617 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.287713 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.287926 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288018 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288232 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288317 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288550 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288646 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288855 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.288948 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.289163 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.289248 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.289468 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.289554 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.289781 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.289874 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.290092 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.290178 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.290419 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.290524 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.290730 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.290828 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291043 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291134 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291367 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291455 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291679 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291766 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.291993 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.292078 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.292310 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.292424 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.292613 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.292701 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.292921 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293007 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293243 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293335 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293551 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293646 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293859 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.293962 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.294166 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.294259 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.294493 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.294594 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.294821 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.294916 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.295139 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.295224 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.295440 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.295524 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.295754 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.295848 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.296068 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.296155 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.296374 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.296467 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.296691 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.296786 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.297002 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.297835 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.297931 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.298173 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.298269 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.298511 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.298598 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.298825 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.298911 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.299549 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.299663 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.299747 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.299831 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.299912 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.299990 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300068 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300155 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300359 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300446 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300671 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300772 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.300987 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301093 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301297 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301382 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301600 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301685 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301912 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.301998 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.302221 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.302307 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.302557 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303128 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303243 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303326 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303413 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303493 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303580 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303748 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.303888 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.304070 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.304166 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.304385 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.304481 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.304705 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.304794 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305016 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305103 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305336 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305433 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305635 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305721 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.305941 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306027 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306247 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306363 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306578 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306694 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306884 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.306976 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.307185 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.307278 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.307492 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.307588 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.307799 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.307937 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.308109 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.308203 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.308413 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.308509 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.308718 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.308811 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309053 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309139 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309359 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309459 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309676 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309763 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.309981 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.310067 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.310288 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.310432 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.310617 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.310706 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.310946 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311093 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311236 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311336 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311541 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311627 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311847 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.311933 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.312155 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.312254 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.312466 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.312552 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.312831 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.312918 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.313174 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.313268 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.313491 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.313577 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.313803 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.313890 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.314122 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.314222 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.314450 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.314538 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.314758 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.314855 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315067 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315156 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315374 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315459 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315679 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315765 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.315985 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316071 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316293 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316378 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316598 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316683 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316908 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.316994 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.317215 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.317299 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.317522 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.317606 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.317826 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.317919 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.318127 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.318212 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.318462 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.318564 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.318770 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.319124 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.319347 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.319434 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.319658 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.319758 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.319961 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320074 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320265 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320358 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320574 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320670 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320879 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.320966 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.321182 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.321267 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.321488 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.321582 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.321792 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.321886 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.322109 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.322196 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.322438 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.322533 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.322747 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.322835 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323052 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323145 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323359 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323446 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323664 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323748 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.323965 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324090 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324268 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324356 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324573 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324660 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324881 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.324968 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.325182 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.325276 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.325484 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.325570 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.325786 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.325880 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.326092 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.326178 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.326419 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.326520 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.326731 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.326826 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327039 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327125 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327343 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327428 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327657 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327751 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.327963 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.328049 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.328268 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.328355 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.328609 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.328705 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.328920 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329006 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329225 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329321 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329531 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329626 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329835 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.329924 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.330141 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.330235 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.330471 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.330568 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.330782 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.330868 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.331092 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.331199 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.331402 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.331492 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.331707 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.331794 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332008 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332095 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332337 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332424 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332649 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332748 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.332980 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.333079 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.333294 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.333435 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.333608 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.333696 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.333917 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334016 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334225 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334310 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334561 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334648 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334878 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.334998 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.335180 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.335319 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.335490 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.335576 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.335798 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.335893 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.336109 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.336196 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.336409 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.336494 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.336715 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.336810 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337026 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337111 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337335 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337425 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337643 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337736 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.337953 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.338042 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.338263 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.338376 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.338618 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.338713 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.338922 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339011 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339228 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339343 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339534 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339627 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339838 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.339923 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.340144 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.340229 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.340451 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.340537 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.340758 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.340894 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.341071 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.341210 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.341384 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.341532 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.341696 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.341841 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342006 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342156 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342314 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342494 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342651 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342815 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.342966 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.343138 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.343272 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.343447 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.343604 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.343871 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.344471 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.344723 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.344810 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345040 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345126 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345355 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345453 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345661 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345746 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.345966 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.346058 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.346276 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.346441 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.346656 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.346750 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.346969 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.347055 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.347278 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.347373 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.347589 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.347675 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.347917 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348003 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348227 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348369 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348546 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348631 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348855 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.348964 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.349277 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.349364 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.349585 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.349669 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.349895 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.350006 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.350210 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.350322 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.350548 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.350672 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.350855 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351001 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351169 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351328 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351496 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351661 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351803 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.351975 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.352109 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.352296 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.352416 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.352611 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.352740 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.352940 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.353047 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.353268 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.353361 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.353582 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.353776 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.353902 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.354091 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.354212 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.354422 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.354570 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.354842 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.354940 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.355161 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.355255 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.355516 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.355716 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.355940 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.356036 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.356273 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.356359 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.356592 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.356679 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.356921 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357008 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357253 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357339 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357563 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357656 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357870 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.357964 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.358188 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.358281 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.358522 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.358610 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.358835 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.358933 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.359141 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.359227 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.359459 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.359544 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.360326 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.360418 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.360715 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.360815 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361000 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361302 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361388 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361477 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361614 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361704 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361880 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.361976 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.362188 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.362332 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.362541 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.362629 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.362863 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.362975 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.363191 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.363288 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.363516 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364089 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364089 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364303 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364419 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364537 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364644 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364749 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364864 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.364970 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365075 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365195 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365310 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365423 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365609 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365723 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.365916 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.366038 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.366222 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.366336 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.366573 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.366695 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.366882 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367014 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367207 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367329 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367526 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367643 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367852 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.367967 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.368175 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.368290 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.368482 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.368595 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.368806 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.368921 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.369116 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.369277 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.369423 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.369564 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.369725 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.369813 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370031 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370126 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370336 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370513 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370667 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370762 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.370982 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.371070 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.371290 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.371426 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.371600 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.371724 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.371915 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372010 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372241 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372337 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372553 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372648 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372867 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.372960 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.373181 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.373268 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.373492 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.373578 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.373794 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.373890 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.374100 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.374186 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.374429 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.374556 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.374740 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.374827 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.375052 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.375156 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.375405 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.375493 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.375722 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.375808 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376030 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376117 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376337 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376433 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376643 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376741 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.376966 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377066 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377273 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377407 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377598 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377694 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377911 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.377998 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.378219 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.378305 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.378551 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.378678 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.378860 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.378947 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.379168 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.379301 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.379486 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.379609 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.379805 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.379920 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.380127 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.380249 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.380449 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.380703 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.380825 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381038 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381152 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381359 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381487 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381678 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381792 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.381995 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.382116 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.382310 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.382477 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.382649 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.382762 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.382965 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.383078 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.383276 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.383397 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.383590 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.383703 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384333 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384428 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384511 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384591 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384669 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384748 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384834 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.384923 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.385182 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.385352 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.385503 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.385685 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.385824 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386005 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386145 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386324 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386474 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386667 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386838 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.386986 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.387162 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.387305 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.387473 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.387621 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.387792 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.387937 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.388112 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.388253 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.388431 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.388571 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.388748 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.388902 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389063 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389233 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389388 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389562 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389697 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389904 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.389991 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.390225 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.390318 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.390569 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.390659 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.390930 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.391030 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.391252 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.391349 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.391615 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.391704 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.391935 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392021 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392247 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392348 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392565 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392658 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392882 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.392975 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.393200 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.393410 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.393519 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.393736 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.393829 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.394079 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.394175 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.394435 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.394525 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.394768 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.394856 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.395086 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.395180 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.395397 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.395489 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.395713 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.395801 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396027 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396304 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396400 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396486 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396648 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396784 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.396980 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.397071 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.397267 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.397376 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.397591 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.397679 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.397913 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.398228 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.398327 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.398577 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.398780 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.398897 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.399156 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.399442 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.399563 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.399832 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.399924 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.400222 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.400366 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.400590 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.400717 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.400922 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.401010 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.401248 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.401376 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.401565 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.401663 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.401904 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.402034 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.402218 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.402342 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.402570 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.402716 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.402894 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.403050 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.403218 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.403438 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.403556 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.403781 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.403877 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.404119 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.404281 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.404436 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.404538 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.404780 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.405051 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.405156 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.405389 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.405506 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.405724 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.405818 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.406038 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.406146 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.406389 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.407044 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.407217 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.407372 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.407538 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.407684 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.407854 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.408057 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.408184 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.408414 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.408512 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.408743 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.408851 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409064 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409177 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409370 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409529 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409697 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409839 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.409997 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.410130 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.410310 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.410572 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.410680 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.410929 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411018 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411239 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411362 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411571 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411702 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411888 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.411976 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.412201 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.412300 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.412527 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.412662 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.412842 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.412931 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.413173 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.413307 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.413490 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.413582 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.413811 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.413990 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.414174 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.414402 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.414500 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.414686 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.415041 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.415159 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.415400 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.415509 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.415748 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.415834 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.416068 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.416175 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.416430 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.416581 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.416740 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.416858 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.417048 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.417153 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.417361 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.417452 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.417713 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.417882 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418017 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418130 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418316 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418613 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418715 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418863 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.418979 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.419189 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.419305 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.419555 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.419785 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.419963 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420080 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420190 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420334 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420466 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420640 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420842 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.420994 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.421185 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.421353 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.421510 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.421791 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.422003 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.422248 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.423009 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.423327 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.423570 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.423803 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.424048 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.424153 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.424373 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.424592 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.424739 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.424832 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.425115 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.425296 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.425443 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.425577 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.425808 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.425898 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.426145 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.426245 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.426590 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.426687 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.426917 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.427077 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.427243 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.427337 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.427601 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.427699 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.427941 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.428106 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.428243 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.428385 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.428546 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.428776 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.428903 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.429088 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.429270 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.429471 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.429564 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.429795 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.429924 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.430184 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.430342 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.430483 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.430561 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.430870 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431077 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431309 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431408 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431547 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431698 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431785 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.431931 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.432041 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.432230 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.432347 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.432577 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.432713 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.432928 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.433165 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.433290 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.433400 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.433602 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.433727 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.433936 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.434032 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.434322 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.434591 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.434745 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.434928 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.435108 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.435262 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.435438 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.435759 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.435861 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.436101 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.436235 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.436422 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.436511 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.436745 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.436899 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.437062 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.437224 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.437381 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.437698 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.437837 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.438060 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.438157 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.438414 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.438516 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.438750 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.438837 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.439067 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.439163 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.439427 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.439525 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.439779 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.439883 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.440095 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.440242 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.440458 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.440609 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.440804 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.440962 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.441180 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.441306 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.441526 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.441706 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.441900 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.441995 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.442246 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.442370 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.442588 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.442704 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.442918 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.443022 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.443247 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.443378 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.443578 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.443722 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.444183 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.444336 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.444517 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.444864 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.445010 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.445188 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.445324 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.445506 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.445996 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.446103 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.446680 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.446833 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.446833 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.447259 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.447481 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.447626 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.447766 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.447766 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 14 09:36:34.448082 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.448082 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.448366 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.448723 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.449246 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.449635 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.450248 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.450599 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.451010 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.451485 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.451867 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.452259 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.452790 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.453158 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.453619 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.454194 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.454833 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.455404 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.455780 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.456235 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.456624 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.456994 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.457397 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.457853 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.458553 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.458843 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.459175 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.459757 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.460269 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:36:34.460527 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 14 09:36:34.471710 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_db.sqlalchemy.engines [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.487538 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_db.sqlalchemy.engines [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.544430 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.context [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26554650-9bca-4ac8-ac00-b49e5e3ee01d(cell1) {{(pid=113642) load_cells /opt/stack/nova/nova/context.py:464}} Jan 14 09:36:34.549289 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_concurrency.lockutils [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:36:34.550978 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_concurrency.lockutils [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:36:34.551820 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_concurrency.lockutils [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:36:34.553789 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_concurrency.lockutils [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:36:34.555915 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.context [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26554650-9bca-4ac8-ac00-b49e5e3ee01d(cell1) {{(pid=113641) load_cells /opt/stack/nova/nova/context.py:464}} Jan 14 09:36:34.560288 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:36:34.561906 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:36:34.562820 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:36:34.564244 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_db.sqlalchemy.engines [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.564796 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:36:34.566937 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_db.sqlalchemy.engines [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.577895 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_db.sqlalchemy.engines [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.582453 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_db.sqlalchemy.engines [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.742687 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_db.sqlalchemy.engines [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:34.745705 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG oslo_db.sqlalchemy.engines [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:36:35.089869 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: WARNING keystonemiddleware.auth_token [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:36:35.090955 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: WARNING keystonemiddleware.auth_token [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:36:35.097252 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: WARNING keystonemiddleware.auth_token [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:36:35.098386 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: WARNING keystonemiddleware.auth_token [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:36:35.445876 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: WARNING keystonemiddleware.auth_token [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:36:35.446997 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: WARNING keystonemiddleware.auth_token [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:36:35.451291 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: WARNING keystonemiddleware.auth_token [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:36:35.452861 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: WARNING keystonemiddleware.auth_token [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:36:35.457008 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582ead029c0 pid: 113641 (default app) Jan 14 09:36:35.459144 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:36:35.459290 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582ead029c0 pid: 113642 (default app) Jan 14 09:36:35.460318 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-96852da2-7247-40be-b3ff-6e0b5e49e37a None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 Jan 14 09:36:35.460727 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Jan 14 09:36:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:03.176295 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:03.177487 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jan 14 09:38:03.178099 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:03.625336 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-055ee11e-f3c7-49ae-b877-be137fcf4046 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:03.666238 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-055ee11e-f3c7-49ae-b877-be137fcf4046 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.481095 Jan 14 09:38:03.667091 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jan 14 09:38:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:06.187863 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:06.188877 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-2029a03a-e5e1-48b7-b59d-8d490992b84f None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 14 09:38:06.189567 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 2/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:06.254513 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-1244466d-9bb5-459f-b106-b57bfe595db7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:06.272874 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:38:06.272874 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: warnings.warn(msg) Jan 14 09:38:06.302572 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-1244466d-9bb5-459f-b106-b57bfe595db7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105905 Jan 14 09:38:06.303143 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 3/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:06.526507 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-a6797081-d112-4ce9-b404-28e1be9de277 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:06.529322 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:38:06.529322 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: warnings.warn(msg) Jan 14 09:38:06.578697 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-a6797081-d112-4ce9-b404-28e1be9de277 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267256 Jan 14 09:38:06.587191 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 3/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jan 14 09:38:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:08.917448 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-1244466d-9bb5-459f-b106-b57bfe595db7 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:08.919116 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-1244466d-9bb5-459f-b106-b57bfe595db7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 Jan 14 09:38:08.919854 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 4/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:09.028284 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-84a0ff98-3d98-46a3-8f22-da695f8dfe88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "ram": 512, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:09.046239 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:38:09.046239 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: warnings.warn(msg) Jan 14 09:38:09.066502 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-84a0ff98-3d98-46a3-8f22-da695f8dfe88 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139354 Jan 14 09:38:09.068691 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 4/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:09.080758 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-b6ac9ca3-4ce7-453a-bd23-e2cf09adb45d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:09.082242 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:38:09.082242 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: warnings.warn(msg) Jan 14 09:38:09.118750 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-b6ac9ca3-4ce7-453a-bd23-e2cf09adb45d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041147 Jan 14 09:38:09.119206 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 5/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jan 14 09:38:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:11.712045 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-84a0ff98-3d98-46a3-8f22-da695f8dfe88 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:11.713441 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-84a0ff98-3d98-46a3-8f22-da695f8dfe88 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Jan 14 09:38:11.714328 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:38:11.780314 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-948b5657-d2ac-4689-bdc7-a02a73575e15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "name": "ds1G"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:11.802301 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-948b5657-d2ac-4689-bdc7-a02a73575e15 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080845 Jan 14 09:38:11.802888 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 6/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:38:11.815047 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-bfb7bdd0-2e2c-43a3-a5ed-ee163133a2aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:11.839354 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-bfb7bdd0-2e2c-43a3-a5ed-ee163133a2aa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027834 Jan 14 09:38:11.839950 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 6/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jan 14 09:38:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:14.164514 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-948b5657-d2ac-4689-bdc7-a02a73575e15 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:14.165531 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-948b5657-d2ac-4689-bdc7-a02a73575e15 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jan 14 09:38:14.165944 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 7/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:14.240296 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-707b5dee-82dc-45e8-8b86-c8135fe45e42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:14.263074 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-707b5dee-82dc-45e8-8b86-c8135fe45e42 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089706 Jan 14 09:38:14.263855 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 7/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:14.278254 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-a409c128-75c8-4c9f-95df-d5d84f20c4ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:14.304613 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-a409c128-75c8-4c9f-95df-d5d84f20c4ca admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032241 Jan 14 09:38:14.306580 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 8/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jan 14 09:38:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:16.618207 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-707b5dee-82dc-45e8-8b86-c8135fe45e42 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:16.619364 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-707b5dee-82dc-45e8-8b86-c8135fe45e42 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jan 14 09:38:16.619766 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 8/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:16.688824 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-6f6c8c96-d5a8-44cd-ab5b-213d672720a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:16.708877 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-6f6c8c96-d5a8-44cd-ab5b-213d672720a9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081753 Jan 14 09:38:16.709638 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 9/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:16.721562 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-b4f54738-2ca5-4f45-a588-0278e0bb419d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:16.746917 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-b4f54738-2ca5-4f45-a588-0278e0bb419d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029340 Jan 14 09:38:16.747611 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 9/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jan 14 09:38:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:38:19.230198 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-6f6c8c96-d5a8-44cd-ab5b-213d672720a9 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:19.231942 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-6f6c8c96-d5a8-44cd-ab5b-213d672720a9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002768 Jan 14 09:38:19.234884 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 10/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:38:19.297807 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-5ca56d09-546d-4781-a790-b6277cb842e6 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:19.322267 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-5ca56d09-546d-4781-a790-b6277cb842e6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083668 Jan 14 09:38:19.323151 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jan 14 09:38:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:38:21.919909 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-6f6c8c96-d5a8-44cd-ab5b-213d672720a9 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:21.920924 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-6f6c8c96-d5a8-44cd-ab5b-213d672720a9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 14 09:38:21.921549 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 11/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:22.007711 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-7d953c86-02bc-47b2-8144-17b240576063 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:22.033952 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-7d953c86-02bc-47b2-8144-17b240576063 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.105650 Jan 14 09:38:22.034761 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:22.051191 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-4365315a-806c-496f-9273-834af8fdb3b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:22.087163 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-4365315a-806c-496f-9273-834af8fdb3b4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039352 Jan 14 09:38:22.087990 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 12/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jan 14 09:38:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:24.584075 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-7d953c86-02bc-47b2-8144-17b240576063 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:24.586613 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-7d953c86-02bc-47b2-8144-17b240576063 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003531 Jan 14 09:38:24.587594 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:24.671870 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-e25a0832-8bbb-4f15-95e2-9d43339987a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:24.697267 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-e25a0832-8bbb-4f15-95e2-9d43339987a8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.101327 Jan 14 09:38:24.697969 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 13/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:38:24.714588 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-867d2468-a691-40d0-9afa-5e1d23d2c4be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:24.744305 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-867d2468-a691-40d0-9afa-5e1d23d2c4be admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036522 Jan 14 09:38:24.745588 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 13/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jan 14 09:38:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:38:27.160600 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-e25a0832-8bbb-4f15-95e2-9d43339987a8 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:27.161610 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-e25a0832-8bbb-4f15-95e2-9d43339987a8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jan 14 09:38:27.162310 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:38:27.240230 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-5f88b8bf-b81a-4948-80f1-e5c70679dc68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "name": "m1.medium"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:27.265036 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-5f88b8bf-b81a-4948-80f1-e5c70679dc68 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095865 Jan 14 09:38:27.266191 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 14/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:38:27.279548 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-d2618464-984b-4292-848a-a280b5df64ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:27.307388 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-d2618464-984b-4292-848a-a280b5df64ce admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032436 Jan 14 09:38:27.308198 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 15/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jan 14 09:38:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:38:29.707286 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-5f88b8bf-b81a-4948-80f1-e5c70679dc68 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:29.708298 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-5f88b8bf-b81a-4948-80f1-e5c70679dc68 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 14 09:38:29.708710 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:29.773278 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-623d2163-87f7-43cf-ae65-2900cb853760 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "id": "4"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:29.793390 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-623d2163-87f7-43cf-ae65-2900cb853760 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077442 Jan 14 09:38:29.793946 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 16/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:29.806173 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-27f1b462-fb5a-4028-90b6-9a4bc050c346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:29.831301 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-27f1b462-fb5a-4028-90b6-9a4bc050c346 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029218 Jan 14 09:38:29.832319 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 16/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jan 14 09:38:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:32.173394 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-623d2163-87f7-43cf-ae65-2900cb853760 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:32.175244 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-623d2163-87f7-43cf-ae65-2900cb853760 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002306 Jan 14 09:38:32.175853 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:32.243373 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-46ef71d3-4dea-45c2-bfdf-9ed05a2526db admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "ram": 16384, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:32.268067 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-46ef71d3-4dea-45c2-bfdf-9ed05a2526db admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.085371 Jan 14 09:38:32.268620 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 17/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jan 14 09:38:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:38:32.284136 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-5feea045-397f-47dc-aa5e-cd8851edeb59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:38:32.309337 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-5feea045-397f-47dc-aa5e-cd8851edeb59 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031810 Jan 14 09:38:32.309929 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 18/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jan 14 09:38:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:38:55.877707 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-46ef71d3-4dea-45c2-bfdf-9ed05a2526db admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:55.879077 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-46ef71d3-4dea-45c2-bfdf-9ed05a2526db admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Jan 14 09:38:55.879641 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:55.959152 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-0582af56-9991-4380-b2fb-678b8b5a0922 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:55.976897 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-0582af56-9991-4380-b2fb-678b8b5a0922 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.086958 Jan 14 09:38:55.977445 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jan 14 09:38:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:38:57.359618 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-46ef71d3-4dea-45c2-bfdf-9ed05a2526db admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:57.360618 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-46ef71d3-4dea-45c2-bfdf-9ed05a2526db admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 14 09:38:57.361025 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:57.554423 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-70753c90-d511-419e-81f8-9bdf41897acf admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:57.560036 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.wsgi [None req-70753c90-d511-419e-81f8-9bdf41897acf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 14 09:38:57.560610 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-70753c90-d511-419e-81f8-9bdf41897acf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:38:57.561403 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-70753c90-d511-419e-81f8-9bdf41897acf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058604 Jan 14 09:38:57.561949 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jan 14 09:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 14 09:38:57.572166 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-a24fe1d8-58a0-48c4-98b1-88defd2614b3 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:57.592739 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-a24fe1d8-58a0-48c4-98b1-88defd2614b3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024379 Jan 14 09:38:57.593294 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jan 14 09:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:38:57.603605 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-ecefc78b-2bcf-4d2b-babf-1843667e405c admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:57.624522 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-ecefc78b-2bcf-4d2b-babf-1843667e405c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025002 Jan 14 09:38:57.625082 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jan 14 09:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:38:57.636794 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-f225583c-902d-4757-b3f3-1c7eb16febbc admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:57.642324 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.wsgi [None req-f225583c-902d-4757-b3f3-1c7eb16febbc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 14 09:38:57.642924 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-f225583c-902d-4757-b3f3-1c7eb16febbc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:38:57.643710 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-f225583c-902d-4757-b3f3-1c7eb16febbc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010578 Jan 14 09:38:57.644230 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jan 14 09:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 14 09:38:58.918595 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-ecefc78b-2bcf-4d2b-babf-1843667e405c admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:58.919643 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-ecefc78b-2bcf-4d2b-babf-1843667e405c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Jan 14 09:38:58.920057 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:38:59.116778 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-7ecf4631-10fc-48f9-8971-ff1204e7f8a9 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:59.122661 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.wsgi [None req-7ecf4631-10fc-48f9-8971-ff1204e7f8a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 14 09:38:59.123226 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-7ecf4631-10fc-48f9-8971-ff1204e7f8a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:38:59.124023 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-7ecf4631-10fc-48f9-8971-ff1204e7f8a9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060305 Jan 14 09:38:59.124537 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jan 14 09:38:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 14 09:38:59.135080 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-1a5f6820-2d08-4247-ac8a-98da5d479b63 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:59.148306 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-1a5f6820-2d08-4247-ac8a-98da5d479b63 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017992 Jan 14 09:38:59.148849 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jan 14 09:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:38:59.158934 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-e8a2ffda-a0ff-4269-9259-559acf804518 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:59.172681 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-e8a2ffda-a0ff-4269-9259-559acf804518 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017466 Jan 14 09:38:59.173263 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jan 14 09:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:38:59.183340 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-69365cb8-6afb-4b0e-a584-ed32ac0014b3 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:38:59.188746 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.wsgi [None req-69365cb8-6afb-4b0e-a584-ed32ac0014b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 14 09:38:59.189319 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-69365cb8-6afb-4b0e-a584-ed32ac0014b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:38:59.190115 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-69365cb8-6afb-4b0e-a584-ed32ac0014b3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010922 Jan 14 09:38:59.190659 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 24/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jan 14 09:38:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 14 09:39:00.474695 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-e8a2ffda-a0ff-4269-9259-559acf804518 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:00.476032 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-e8a2ffda-a0ff-4269-9259-559acf804518 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Jan 14 09:39:00.476577 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 24/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:39:00.674720 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-5beccb34-9499-4cfa-92d8-760cbf89a33c admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:00.684680 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.wsgi [None req-5beccb34-9499-4cfa-92d8-760cbf89a33c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 14 09:39:00.685759 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-5beccb34-9499-4cfa-92d8-760cbf89a33c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:39:00.687325 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-5beccb34-9499-4cfa-92d8-760cbf89a33c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068830 Jan 14 09:39:00.688352 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 25/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jan 14 09:39:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 14 09:39:00.699660 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-bddcfdc9-d026-4b39-8845-cd6dd40a5f42 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:00.713254 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-bddcfdc9-d026-4b39-8845-cd6dd40a5f42 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017730 Jan 14 09:39:00.713808 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jan 14 09:39:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:39:00.727156 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:00.747586 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027325 Jan 14 09:39:00.748399 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jan 14 09:39:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:39:00.762829 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-a4c5cc90-aafd-4a6c-ae6a-2ec1a727ce2f admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:00.772499 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.wsgi [None req-a4c5cc90-aafd-4a6c-ae6a-2ec1a727ce2f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 14 09:39:00.773655 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-a4c5cc90-aafd-4a6c-ae6a-2ec1a727ce2f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:39:00.775273 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-a4c5cc90-aafd-4a6c-ae6a-2ec1a727ce2f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018831 Jan 14 09:39:00.776206 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jan 14 09:39:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 14 09:39:02.077934 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:02.079006 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jan 14 09:39:02.079407 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:39:02.280488 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-67dfa09c-ae3e-4377-b379-d52af6567650 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:39:02.299900 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-67dfa09c-ae3e-4377-b379-d52af6567650 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074540 Jan 14 09:39:02.300474 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jan 14 09:39:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:39:03.632018 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:03.633022 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 14 09:39:03.633449 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:39:03.845895 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-24cc5f0b-0f22-4f32-8275-1ec3464cae98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:39:03.863880 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-24cc5f0b-0f22-4f32-8275-1ec3464cae98 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087833 Jan 14 09:39:03.864434 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 28/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jan 14 09:39:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:39:05.154534 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:05.155544 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jan 14 09:39:05.156169 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:39:05.349375 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-f769d20a-5064-426d-a539-4abb9c168feb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:39:05.373790 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-f769d20a-5064-426d-a539-4abb9c168feb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076542 Jan 14 09:39:05.374333 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 29/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jan 14 09:39:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:39:06.657195 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:06.658320 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jan 14 09:39:06.658893 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:39:06.853889 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-522db508-2874-44b0-8cec-535a86da9bb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:39:06.874463 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-522db508-2874-44b0-8cec-535a86da9bb2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074441 Jan 14 09:39:06.875023 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jan 14 09:39:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:39:08.193422 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:08.194444 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 14 09:39:08.194835 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:39:08.395573 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-b0c11d50-02ac-44c1-aef9-6936116a0741 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:08.416185 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-b0c11d50-02ac-44c1-aef9-6936116a0741 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073965 Jan 14 09:39:08.416724 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 31/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Jan 14 09:39:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:39:54.794983 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:54.796153 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-df84460b-9ec3-4f60-a8d5-2d637a417284 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001786 Jan 14 09:39:54.796629 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jan 14 09:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:39:54.856346 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-a2045ddf-7615-4bd6-b10c-59dc7496f6fd admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:54.876617 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-a2045ddf-7615-4bd6-b10c-59dc7496f6fd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072675 Jan 14 09:39:54.877152 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jan 14 09:39:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:39:54.898333 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-15c2530a-8f20-4836-ae32-47bfd91fc852 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:54.906340 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-15c2530a-8f20-4836-ae32-47bfd91fc852 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011484 Jan 14 09:39:54.906892 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 33/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jan 14 09:39:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:39:54.919321 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-f7b54d66-ddbb-4e64-a605-9a7034b68e86 admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:54.928258 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-f7b54d66-ddbb-4e64-a605-9a7034b68e86 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012954 Jan 14 09:39:54.928795 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 33/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jan 14 09:39:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:39:54.940434 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-31a6e815-0795-444d-af4c-68c22c2223c9 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:54.948463 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-31a6e815-0795-444d-af4c-68c22c2223c9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011501 Jan 14 09:39:54.948994 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jan 14 09:39:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:39:54.960868 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:39:54.969577 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012649 Jan 14 09:39:54.970141 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jan 14 09:39:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:41:40.877226 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-bb54bb39-c92e-4ebb-9148-995b4c808003 tempest-verify_tempest_config-697830449 tempest-verify_tempest_config-697830449-project] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:41:40.880364 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-bb54bb39-c92e-4ebb-9148-995b4c808003 tempest-verify_tempest_config-697830449 tempest-verify_tempest_config-697830449-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.151203 Jan 14 09:41:40.881137 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jan 14 09:41:40 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:43:11.274975 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:11.276142 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 14 09:43:11.276829 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:43:11.534941 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-b8fa3087-838e-4fc1-a661-ad5e74634a6a admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:11.536113 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:43:11.536113 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: warnings.warn(msg) Jan 14 09:43:11.537632 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-b8fa3087-838e-4fc1-a661-ad5e74634a6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:11.538096 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-b8fa3087-838e-4fc1-a661-ad5e74634a6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:11.539467 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-b8fa3087-838e-4fc1-a661-ad5e74634a6a admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:11.539894 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-b8fa3087-838e-4fc1-a661-ad5e74634a6a admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:11.572731 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-b8fa3087-838e-4fc1-a661-ad5e74634a6a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.148303 Jan 14 09:43:11.573290 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 36/71] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jan 14 09:43:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:43:12.849855 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:12.850869 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jan 14 09:43:12.851298 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:43:13.041567 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-386282b0-b35e-4e11-b330-9ca74980333d admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:13.042770 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:43:13.042770 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: warnings.warn(msg) Jan 14 09:43:13.044283 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-386282b0-b35e-4e11-b330-9ca74980333d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:13.044728 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-386282b0-b35e-4e11-b330-9ca74980333d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:13.045527 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-386282b0-b35e-4e11-b330-9ca74980333d admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:13.045984 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-386282b0-b35e-4e11-b330-9ca74980333d admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:13.066753 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-386282b0-b35e-4e11-b330-9ca74980333d admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075630 Jan 14 09:43:13.067247 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 37/73] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jan 14 09:43:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:43:24.770867 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:24.771843 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jan 14 09:43:24.772229 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:43:24.965002 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-ed23f8a8-ff53-414e-85fc-166fc408d234 admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:24.966159 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:43:24.966159 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: warnings.warn(msg) Jan 14 09:43:24.967702 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-ed23f8a8-ff53-414e-85fc-166fc408d234 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:24.968144 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-ed23f8a8-ff53-414e-85fc-166fc408d234 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:24.968937 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-ed23f8a8-ff53-414e-85fc-166fc408d234 admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:24.969378 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-ed23f8a8-ff53-414e-85fc-166fc408d234 admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:24.992967 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-ed23f8a8-ff53-414e-85fc-166fc408d234 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079488 Jan 14 09:43:24.993441 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 38/75] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jan 14 09:43:24 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:43:26.277406 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: DEBUG nova.api.openstack.wsgi [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] Calling method '>' {{(pid=113642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:26.278436 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: INFO nova.api.openstack.requestlog [None req-735d0efd-c106-4c9e-979a-7cee83b3b02e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jan 14 09:43:26.278830 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: [pid: 113642|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jan 14 09:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:43:26.472491 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG nova.api.openstack.wsgi [None req-fa10727c-4106-4a19-b90a-df320c06c33d admin admin] Calling method '>' {{(pid=113641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:43:26.473693 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:43:26.473693 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: warnings.warn(msg) Jan 14 09:43:26.475371 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-fa10727c-4106-4a19-b90a-df320c06c33d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:26.475818 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-fa10727c-4106-4a19-b90a-df320c06c33d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:26.476625 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-fa10727c-4106-4a19-b90a-df320c06c33d admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:43:26.477143 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: DEBUG oslo_concurrency.lockutils [None req-fa10727c-4106-4a19-b90a-df320c06c33d admin admin] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:43:26.498027 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: INFO nova.api.openstack.requestlog [None req-fa10727c-4106-4a19-b90a-df320c06c33d admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077998 Jan 14 09:43:26.498633 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: [pid: 113641|app: 0|req: 39/77] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jan 14 09:43:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:44:24.193203 dv-cinder-821602-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 14 09:44:24.193771 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: Fri Jan 14 09:44:24 2022 - graceful shutdown triggered... Jan 14 09:44:24.194201 dv-cinder-821602-11-iscsi devstack@n-api.service[113641]: Gracefully killing worker 1 (pid: 113641)... Jan 14 09:44:24.194617 dv-cinder-821602-11-iscsi devstack@n-api.service[113642]: Gracefully killing worker 2 (pid: 113642)... Jan 14 09:44:25.194537 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: worker 1 buried after 1 seconds Jan 14 09:44:25.194537 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: worker 2 buried after 1 seconds Jan 14 09:44:25.194537 dv-cinder-821602-11-iscsi devstack@n-api.service[113640]: goodbye to uWSGI. Jan 14 09:44:25.196562 dv-cinder-821602-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 14 09:44:25.197104 dv-cinder-821602-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 14 09:44:25.199933 dv-cinder-821602-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 14 09:44:25.208851 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 14 09:44:25 2022] *** Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: nodename: dv-cinder-821602-11-iscsi Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: machine: x86_64 Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: clock source: unix Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: pcre jit disabled Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: detected number of CPU cores: 4 Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: current working directory: / Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: detected binary path: /usr/bin/uwsgi-core Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: your processes number limit is 47680 Jan 14 09:44:25.211494 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: your memory page size is 4096 bytes Jan 14 09:44:25.212262 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: detected max file descriptor number: 2048 Jan 14 09:44:25.212262 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: lock engine: pthread robust mutexes Jan 14 09:44:25.212262 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: thunder lock: enabled Jan 14 09:44:25.212262 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 14 09:44:25.212262 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 14 09:44:25.256686 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: Python main interpreter initialized at 0x564a859899c0 Jan 14 09:44:25.256686 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: python threads support enabled Jan 14 09:44:25.256686 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: your server socket listen backlog is limited to 100 connections Jan 14 09:44:25.256686 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: your mercy for graceful operations on workers is 90 seconds Jan 14 09:44:25.257138 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: mapped 403077 bytes (393 KB) for 2 cores Jan 14 09:44:25.257138 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: *** Operational MODE: preforking *** Jan 14 09:44:25.257426 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: *** uWSGI is running in multiple interpreter mode *** Jan 14 09:44:25.257426 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: spawned uWSGI master process (pid: 128075) Jan 14 09:44:25.258149 dv-cinder-821602-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 14 09:44:25.258808 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: spawned uWSGI worker 1 (pid: 128091, cores: 1) Jan 14 09:44:25.259156 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: spawned uWSGI worker 2 (pid: 128092, cores: 1) Jan 14 09:44:25.259317 dv-cinder-821602-11-iscsi devstack@n-api.service[128075]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 14 09:44:27.267706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:44:27.267706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: from cryptography.utils import int_from_bytes Jan 14 09:44:27.268530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:44:27.268530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: from cryptography.utils import int_from_bytes Jan 14 09:44:27.271995 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:44:27.271995 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: from cryptography.utils import int_from_bytes Jan 14 09:44:27.272569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 14 09:44:27.272569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: from cryptography.utils import int_from_bytes Jan 14 09:44:29.669594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 14 09:44:29.670193 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 14 09:44:29.670499 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 14 09:44:29.670778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 14 09:44:29.671027 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 14 09:44:29.671422 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.671756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.672086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.672415 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.672752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.673074 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.673402 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.673729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.674067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.674337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.674672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.675006 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-11-iscsi {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.675335 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.675651 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.675969 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.676298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.676611 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.676943 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.677254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.677764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.679504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.679504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.679504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.679504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.679504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.679885 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.680135 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.680448 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.680767 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.681100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.681506 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-11-iscsi {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.681837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.682146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.682495 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.682932 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.683256 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.683568 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.683895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.684228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.684546 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.684878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.685207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.685535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.685864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.686189 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.686516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.686834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.687162 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.687494 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.687792 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.688050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.688369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.688704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.689298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.689631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.689892 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.690153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.690504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.690835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.691154 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.691471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.691786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.692115 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.692425 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.692742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.693059 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.693377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.693702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.694031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.694386 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.694703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.695570 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.695977 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.696237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.696563 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.696908 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.697239 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.697554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.697883 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.698153 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 14 09:44:29.698652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.698811 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 14 09:44:29.698969 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.698969 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.699238 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 14 09:44:29.699391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.699535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 14 09:44:29.699690 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.699902 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 14 09:44:29.700063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.700208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.700356 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.700500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.700655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.700806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.700994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.701148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.701318 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.701480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.701625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.701796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.701978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.702129 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.702281 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.702497 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.702644 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.702786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.702927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703239 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703687 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-11-iscsi {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703830 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.703989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.704167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.704313 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.704476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.704627 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.704798 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.704969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.705114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.705257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.705404 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.705547 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.705690 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.705879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.706044 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.706044 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.706331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.706516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.706671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.706870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.707026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.707169 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.707500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.707652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.708290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.708456 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.708606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.708811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.708968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709112 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709404 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709847 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.709997 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.710148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.710309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.710309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.711211 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-11-iscsi {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.711366 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.711541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.711702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.711854 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712007 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712162 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712312 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.712914 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713068 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713360 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713502 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.713950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.714238 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.714418 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.714569 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.714726 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.714878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715038 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715350 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715503 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715804 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.715946 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716237 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716690 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.716991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.717132 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.717282 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.717500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.717722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.717907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.718591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.718747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.718901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.719057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.719207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.719364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.719529 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.719690 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.719835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.719977 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.720120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.720269 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.720646 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.720810 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.720963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.721117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.721266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.721424 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.721577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.721730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.721872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.722021 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.722173 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.722324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.722543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.722698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.722848 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.723033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.723033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.723313 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.723548 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.723702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.723853 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.724004 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.724004 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.724361 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.724523 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.724675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.724819 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.724970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.725122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.725274 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.725426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.725581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.725726 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.725868 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.726017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.726175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.726319 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.726487 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.726631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.726775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.726917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.727075 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.727226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.727380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.727531 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.727819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.727982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.728159 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.728159 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.728988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.728988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.729280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.729433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.729591 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.729742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.729886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.729886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.730174 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.730327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.730542 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.730696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.730839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.730990 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.731134 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.731285 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.731435 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.731584 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.731734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.731876 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.732028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.732180 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.732332 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.732476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.732628 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.732781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.732932 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.733086 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.733230 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.733389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.733532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.733679 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.733829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.733991 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.734136 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.734278 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.734532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.734682 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.734847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.734991 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.735141 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.735285 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.735427 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.735575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.735726 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.735871 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.736023 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.736174 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.736325 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.736468 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.736623 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.736775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.736918 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.737078 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.737232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.737387 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.737538 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.737681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.737978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.738136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.738295 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.739097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.739271 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.739423 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.739612 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.739769 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.739924 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.740069 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.740219 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.740364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.740507 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.740675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.740819 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.740970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.741114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.741256 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.741412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.741569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.741735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.744739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.744912 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.745073 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.745233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.745380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.745551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.745697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.745841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.745993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.746151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.746303 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.746514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.746662 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.746812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.746956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.747115 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.747268 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.747412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.747566 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.747725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.747881 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.748139 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.748292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.748444 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.749293 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.749456 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.749612 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.749758 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.749901 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 14 09:44:29.750044 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.750044 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.750341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.750594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.750749 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.750895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751050 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751502 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.751944 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752247 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752696 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.752992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.753149 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.753294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.753444 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.753595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.754323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.754548 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.754723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755006 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755312 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755629 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.755928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756072 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756214 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756650 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.756956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.757100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.757769 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.757932 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.758102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.758334 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.758514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.758668 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.758838 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.759554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.759709 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.759860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760015 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760313 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760469 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760621 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.760915 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761200 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761497 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761639 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761789 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.761949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.762109 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.762261 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.762475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.762626 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.762776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.762967 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.763130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.763286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.763438 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.763589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.763740 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.763890 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.764057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.764208 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.764360 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.764514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.764659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.764842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.765086 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.765237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.765388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.765540 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.765692 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.765845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766000 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766303 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766469 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.766943 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.767087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.767229 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.767749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.767912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.768075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.768220 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.768480 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.768641 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.768797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.768797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.769103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.770033 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.770194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.770340 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.770523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.770755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.770916 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.771068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.771219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.771384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.771529 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.771753 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.771913 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.772064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.772216 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.772361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.772511 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.772664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.772810 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.773576 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.773729 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.773873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774027 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774336 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774506 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.774962 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.775214 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.775533 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.775686 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.775830 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.775974 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.776137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.776325 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.776517 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.776670 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.776822 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.776965 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.777118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.777270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.777432 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.778176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.778414 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.778680 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.778848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.779010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.779163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.779628 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.780143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.780306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.780452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.780594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.780745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.780936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.781085 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.781252 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.781404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.781553 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.781714 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.781872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.782030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.782190 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.782367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.782524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.782685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.782845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783004 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783469 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783625 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.783936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.784096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.784254 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.784406 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.784555 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.784712 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.784943 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.785096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.785334 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.785537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.785702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.785853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.786023 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.786181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.786339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.786552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.786702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.786851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.787012 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.787212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.787371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.787522 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.787678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.787844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.788021 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.788182 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.788340 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.788491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.788700 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.788942 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.789097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.789247 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.789396 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.789769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.790091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.790469 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.790625 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.790799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.790950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.791099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.791248 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.791409 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.791567 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.791726 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.791878 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792037 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792356 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792507 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792657 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792825 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.792976 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.793139 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.793298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.793448 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.793605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.793755 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.793906 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.794064 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.794228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.794426 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.794583 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.794743 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.794904 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795055 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795213 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795774 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795934 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.795934 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796484 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796572 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796789 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.796958 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797051 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797051 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797296 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797421 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797539 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.797950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798446 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798569 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798682 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798792 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.798920 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.799123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.799249 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.799370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.799489 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.799601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.799931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.800222 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.800543 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.800672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.800793 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.800913 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801025 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801147 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801268 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801386 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801498 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801608 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801733 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.801974 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802248 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802835 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.802947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803064 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803175 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803295 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803406 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803515 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.803898 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.804026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.804678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.804806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.804918 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805154 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805393 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805599 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.805951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806070 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806310 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806446 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.806735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.807343 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.807472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.807585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.807703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.807821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.807938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808056 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808335 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808468 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808691 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808815 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.808926 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.809044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.809255 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.809374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.809485 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.809609 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.809722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.810035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.810306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.810492 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.810797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.810927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811040 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811158 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811553 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.811967 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812149 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812401 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.812963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.813087 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.813199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.813199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.813414 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.813524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.813642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814246 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.814909 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815022 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815379 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.815946 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816059 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816178 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816289 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816474 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816596 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816828 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.816952 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817293 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817410 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817640 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817751 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817861 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.817971 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818213 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818338 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818523 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818652 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.818999 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.819163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.819367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.819486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.819607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.819720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.820684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.820987 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821108 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821230 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821455 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821758 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.821876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.822019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.823736 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.823873 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.823999 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824122 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824362 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824700 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.824923 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825048 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825162 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825282 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825450 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825690 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.825822 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826139 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826250 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.826814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827027 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.827998 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828110 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828338 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828461 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828582 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.828972 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829098 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829359 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.829915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.830027 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.830145 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.830335 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.830473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.830926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831038 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831161 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831273 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831393 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831615 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.831917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832272 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832392 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832511 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832865 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.832984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833095 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833205 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833324 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833436 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833559 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.833895 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834229 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834385 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834516 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834645 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.834903 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835045 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835447 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835834 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.835953 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836159 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836278 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836507 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836629 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836869 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.836982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837398 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.837990 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838102 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838211 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838490 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.838867 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839322 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839763 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.839887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.840008 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.840120 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.840229 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.840353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.840512 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.840643 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841019 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841384 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841495 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.841843 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842396 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842634 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842744 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.842986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.843097 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.843925 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844278 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844662 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.844921 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845161 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845282 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845402 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845756 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.845988 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846107 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846313 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.846974 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847092 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847330 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847450 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847791 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.847910 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.848023 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.848133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.848262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.848866 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.848998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.849122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.849325 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.849454 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.849575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.849686 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.849890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850024 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850145 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850257 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850396 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850650 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.850769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851231 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851362 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.851956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852401 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852871 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.852990 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.853676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.853812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.853960 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854444 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.854918 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855056 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855174 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855285 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855403 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.855868 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856035 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856155 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.856978 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.857167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.857300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.857914 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858267 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858419 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858538 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858657 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858769 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.858878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859003 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859243 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859463 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.859823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860272 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860383 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860741 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.860861 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.861311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.861436 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.861556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.861681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.861802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.861915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.862033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.862144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.862267 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.862447 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.862683 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.862829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863067 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863200 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863746 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.863882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864427 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864557 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.864953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865223 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865351 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.865900 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.866030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.866201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867464 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867593 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867977 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.867977 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.868201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.868298 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.868298 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.868962 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869094 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869286 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869286 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.869989 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870153 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870556 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.870948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871512 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871512 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871881 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871974 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.871974 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872143 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872319 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872670 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872670 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872843 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872987 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.872987 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873179 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873742 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.873920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.874083 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.874384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.874495 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.874768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.874867 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.875107 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.875435 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.875586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.875764 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.876039 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.876131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.876403 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.876553 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.876719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877347 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877805 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.877952 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.878104 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.878272 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.878442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.878614 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.878766 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.878931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.879081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.879245 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.879393 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.879581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.879764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.879904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.880069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.880232 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.880337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.880555 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.880659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.880872 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.881000 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.881183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.881322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.881500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.881597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.881851 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.882050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.882162 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.882986 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.883106 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.883317 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.883644 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.883739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.883978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.884233 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.884414 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.884620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.884874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.885036 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.885254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.885435 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.885575 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.885875 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.885969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.886198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.886300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.886541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.886710 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.886917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.887096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.887211 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.887347 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.887468 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.887764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.887926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.888076 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.888315 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.888497 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.888649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.888814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.888982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.889218 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.889376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.889598 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.889815 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.889998 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.890215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.890434 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.890633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.890967 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.891137 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.891294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892172 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892279 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892377 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.892923 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893097 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893174 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893504 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.893940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.894156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.894260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.894534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.894631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.894858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.894970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.895178 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.895283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.895513 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.895609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.895828 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.895994 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.896144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.896333 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.896521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.896674 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.896852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.897167 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.897418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.897516 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.897812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.898463 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.898818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.898929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.899013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.899085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.899394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.899503 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.899723 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.899877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900040 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900307 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.900979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.901074 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.901301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.901464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.901621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.901743 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902033 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902176 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902267 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902560 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902880 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.902975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.903198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.903291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.903516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.903617 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.903839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.903932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.904189 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.904283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.904519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.904619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.904845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.904946 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.905168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.905269 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.905493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.905584 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.905811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.906051 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.906153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.906401 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.906499 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.906754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.906847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.907073 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.907206 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.907418 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.907510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.907740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.907830 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.908054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.908162 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.908400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.908492 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.908720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.908836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.909042 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.909148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.909366 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.909471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.909690 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.909797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.910009 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.910110 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.910399 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.910498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.910687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.910788 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.911001 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.911092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.911320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.911411 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.911645 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.911750 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912328 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912557 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.912980 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.913224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.913326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.913605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.914204 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.914434 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.914545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.914766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.914866 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.915105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.915209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.915423 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.915523 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.915742 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.915842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.916064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.916164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.916388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.916479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.916703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.916801 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917109 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917447 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917661 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.917975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.918067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.918299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.918420 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.918641 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.918741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.918963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.919055 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.919283 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.919379 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.919641 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.919751 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.919915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920325 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920651 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.920968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.921182 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.921274 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.921498 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.921605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.921823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.921960 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.922229 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.922521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.922521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.922701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.922789 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.922874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.923100 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.923207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.923418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.923510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.923737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.923829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.924055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.924155 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.924374 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.924469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.924695 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.924790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925340 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925434 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925663 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.925998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.926099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.926323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.926494 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.926680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.926788 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.927024 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.927126 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.927364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.927500 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.927699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.927911 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.928016 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.928306 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.928401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.928621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.928723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.928872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 14 09:44:29.928965 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.929369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.929688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.930008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.930657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.930657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.930998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.931320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.931644 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.931968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.932293 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.932613 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.932937 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.933259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.933581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.933908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.934266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.934633 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.934968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.935300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.935631 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.935956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.936280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.936606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.936928 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.937256 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.937605 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.937934 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.938251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.938964 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.939301 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.939635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.939967 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.940291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.940626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.940962 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.941288 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.941623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.941946 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.942291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.942668 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.943011 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.943348 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.943669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.943988 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.944308 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.944634 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.945022 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.945368 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.945696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.946032 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.946410 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.946716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.947044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.947381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.947714 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.948045 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.948365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.948707 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.949029 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.949353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.949768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.950056 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.950321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.950739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.951134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.951376 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.951681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.952017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.952360 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.952697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.953026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.953128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:29.953351 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.953692 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.954014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.954341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.954691 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.955016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.955344 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.955671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.956007 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.956345 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.956681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.957019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.957392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.957718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.958077 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.958448 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.958779 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.959101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.959421 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 14 09:44:29.959762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 14 09:44:29.983549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_db.sqlalchemy.engines [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.019589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.context [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26554650-9bca-4ac8-ac00-b49e5e3ee01d(cell1) {{(pid=128091) load_cells /opt/stack/nova/nova/context.py:464}} Jan 14 09:44:30.024402 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:44:30.025984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:44:30.026839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:44:30.028756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:44:30.039714 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.041031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.050127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.context [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26554650-9bca-4ac8-ac00-b49e5e3ee01d(cell1) {{(pid=128092) load_cells /opt/stack/nova/nova/context.py:464}} Jan 14 09:44:30.054498 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:44:30.056083 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:44:30.056929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:44:30.058892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:44:30.069665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_db.sqlalchemy.engines [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.071254 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_db.sqlalchemy.engines [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.204172 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.235436 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_db.sqlalchemy.engines [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 14 09:44:30.639131 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: WARNING keystonemiddleware.auth_token [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:44:30.646157 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: WARNING keystonemiddleware.auth_token [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:44:30.677541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: WARNING keystonemiddleware.auth_token [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:44:30.684724 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: WARNING keystonemiddleware.auth_token [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:44:30.870974 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: WARNING keystonemiddleware.auth_token [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:44:30.876067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: WARNING keystonemiddleware.auth_token [None req-ac0fb894-11be-41f2-9f84-8dd767a6a026 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:44:30.881470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564a859899c0 pid: 128091 (default app) Jan 14 09:44:30.912857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: WARNING keystonemiddleware.auth_token [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 14 09:44:30.920399 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: WARNING keystonemiddleware.auth_token [None req-8a84772d-122a-4c6f-807c-6875ee176daf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 14 09:44:30.925424 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564a859899c0 pid: 128092 (default app) Jan 14 09:45:06.872395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-597e7f0f-c027-4593-bc90-fb0f7daf3136 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Action: 'create', calling method: .version_select at 0x7fd3241f61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1063965470"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:07.338244 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-acd9c1da-96f0-4abd-9f7a-d1f100a4e64b tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd324220ee0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:07.848210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-acd9c1da-96f0-4abd-9f7a-d1f100a4e64b tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7a2b5d43-c98b-4456-bb9b-1311a0a2dc93" status: 200 len: 350 microversion: 2.1 time: 1.085752 Jan 14 09:45:07.856191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:06 2022] GET /compute/v2.1/os-volumes/7a2b5d43-c98b-4456-bb9b-1311a0a2dc93 => generated 350 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:07.994262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-470143046", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "5c129436-5473-42d9-ac32-ac708e97640c"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:08.275343 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] validate_networks() for [('5c129436-5473-42d9-ac32-ac708e97640c', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:45:08.294683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-597e7f0f-c027-4593-bc90-fb0f7daf3136 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.578484 Jan 14 09:45:08.304627 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 1/2] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Jan 14 09:45:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2590 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 14 09:45:08.309959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bd33dbf0-606a-4907-9edd-a57f0c1c1aed tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd3240b5dc0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:08.481589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bd33dbf0-606a-4907-9edd-a57f0c1c1aed tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497" status: 200 len: 346 microversion: 2.1 time: 0.175462 Jan 14 09:45:08.482170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:08 2022] GET /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497 => generated 346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:08.494686 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e7fe5aa2-31c3-47f8-9867-536e97bf614a tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Action: 'create', calling method: .version_select at 0x7fd3240b5f70>, body: {"snapshot": {"volume_id": "abcf1368-b0b5-4a87-97c0-524ca23ab497", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-378285256"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:08.941979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e7fe5aa2-31c3-47f8-9867-536e97bf614a tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.451519 Jan 14 09:45:08.948745 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 3/4] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Jan 14 09:45:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:08.953745 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3b2c7a8f-a5e5-4a16-9b6f-5768e1ee33ce tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd32404d9d0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:09.004583 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3b2c7a8f-a5e5-4a16-9b6f-5768e1ee33ce tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 200 len: 286 microversion: 2.1 time: 0.054580 Jan 14 09:45:09.006215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 4/5] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:08 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:09.015320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2a647870-7af3-47bf-b4de-74c49c055813 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd3240543a0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:09.119713 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2a647870-7af3-47bf-b4de-74c49c055813 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.108206 Jan 14 09:45:09.120602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 5/6] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jan 14 09:45:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:45:09.132152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ee5ef8cd-8a25-451e-ab2c-2b82c8367bf4 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd324054dc0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:09.188152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ee5ef8cd-8a25-451e-ab2c-2b82c8367bf4 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 200 len: 286 microversion: 2.1 time: 0.060036 Jan 14 09:45:09.189489 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 6/7] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:09 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:09.493120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-50f87451-364e-43e5-b415-3e0901a50107 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd324054700>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:09.595097 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-50f87451-364e-43e5-b415-3e0901a50107 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a2db2db2-ee5c-4e77-b0de-adef0f9f71ff" status: 200 len: 350 microversion: 2.1 time: 0.104022 Jan 14 09:45:09.604016 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 7/8] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:09 2022] GET /compute/v2.1/os-volumes/a2db2db2-ee5c-4e77-b0de-adef0f9f71ff => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:10.204072 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7a9e0e22-1c6d-4c07-83c3-427c22804783 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd32404d160>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:10.306440 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7a9e0e22-1c6d-4c07-83c3-427c22804783 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 200 len: 286 microversion: 2.1 time: 0.108669 Jan 14 09:45:10.307358 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 8/9] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:10 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:10.344134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:45:10.344857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:45:10.345888 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:45:10.346887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:45:10.348030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:45:10.389250 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:10.389700 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:10.390940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:10.390940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:10.431995 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Getting quotas for project f1e5d5139bc44adcb0fe4ddddf73580c. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:10.439635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Getting quotas for user 45a23d840c9249809fa7c8a7b0afeabf and project f1e5d5139bc44adcb0fe4ddddf73580c. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:10.459788 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:45:10.463931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:45:10.623691 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f403b8c7-bba0-4576-af0d-d0189d0f58b3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.766011 Jan 14 09:45:10.625872 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 2/10] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:45:10.636745 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-79415e29-945c-4279-86ec-a92cf5a3feb3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:10.638105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-79415e29-945c-4279-86ec-a92cf5a3feb3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:10.870223 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-79415e29-945c-4279-86ec-a92cf5a3feb3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:10.886216 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-79415e29-945c-4279-86ec-a92cf5a3feb3 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1214 microversion: 2.1 time: 0.253047 Jan 14 09:45:10.900225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 9/11] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:10 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:11.323099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-de81a5b1-7917-4a16-80a8-e7f73fc5bff9 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd323fbc8b0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:11.391118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-de81a5b1-7917-4a16-80a8-e7f73fc5bff9 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 200 len: 286 microversion: 2.1 time: 0.075505 Jan 14 09:45:11.392845 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 3/12] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:11 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:45:11.903265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1db6a87e-624d-40c5-bb52-c40371cc38c4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:11.903920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1db6a87e-624d-40c5-bb52-c40371cc38c4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:12.098629 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1db6a87e-624d-40c5-bb52-c40371cc38c4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:12.112344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1db6a87e-624d-40c5-bb52-c40371cc38c4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1214 microversion: 2.1 time: 0.212639 Jan 14 09:45:12.113586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 10/13] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:11 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:12.405010 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f8b56010-9536-43a0-bf16-3edf481b3e66 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd322f504c0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:12.464904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f8b56010-9536-43a0-bf16-3edf481b3e66 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 200 len: 287 microversion: 2.1 time: 0.064700 Jan 14 09:45:12.465423 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 4/14] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:12 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:12.476179 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9950559e-7b9f-44ac-bbb5-84ed1c960226 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd32401e160>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:12.624451 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9950559e-7b9f-44ac-bbb5-84ed1c960226 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 202 len: 0 microversion: 2.1 time: 0.152488 Jan 14 09:45:12.625711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 11/15] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jan 14 09:45:12 2022] DELETE /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:45:12.637973 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-182309f5-615f-45ae-bd96-9e27b53a25c9 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd323fbca60>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:12.732299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-182309f5-615f-45ae-bd96-9e27b53a25c9 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 200 len: 286 microversion: 2.1 time: 0.102582 Jan 14 09:45:12.733387 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 5/16] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:12 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:13.129842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:13.131981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:13.143120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:13.143889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:13.151338 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:13.152192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:13.453460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-97ec786f-5914-4857-a217-291bf6e9a412 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd322f50ca0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:13.556457 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-97ec786f-5914-4857-a217-291bf6e9a412 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd50b21-21a1-44ed-82ce-fa3617acb8a7" status: 200 len: 351 microversion: 2.1 time: 0.110994 Jan 14 09:45:13.557330 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 6/17] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:13 2022] GET /compute/v2.1/os-volumes/4bd50b21-21a1-44ed-82ce-fa3617acb8a7 => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:45:13.580014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4483da7f-e56a-4323-a66d-748ce8c90c2c tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd322f50280>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:13.824017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4483da7f-e56a-4323-a66d-748ce8c90c2c tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.258670 Jan 14 09:45:13.825261 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 7/18] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jan 14 09:45:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:13.830219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-72bad4e1-9c00-46ee-80d0-2487df8c0067 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd322f50dc0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:13.863222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-72bad4e1-9c00-46ee-80d0-2487df8c0067 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] HTTP exception thrown: Snapshot 2a1a6295-c476-4658-ab86-1a6d68d6b692 could not be found. Jan 14 09:45:13.864155 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-72bad4e1-9c00-46ee-80d0-2487df8c0067 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Returning 404 to user: Snapshot 2a1a6295-c476-4658-ab86-1a6d68d6b692 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:13.865291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-72bad4e1-9c00-46ee-80d0-2487df8c0067 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692" status: 404 len: 111 microversion: 2.1 time: 0.038809 Jan 14 09:45:13.866469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 8/19] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:45:13 2022] GET /compute/v2.1/os-snapshots/2a1a6295-c476-4658-ab86-1a6d68d6b692 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:45:13.875999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-26fd1afd-d4fa-4bdb-8161-ff5a2c6e4e48 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd324a23820>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:13.911078 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:13.937711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-411db0e8-1310-4634-ab11-2db046455f8d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1266 microversion: 2.1 time: 0.811436 Jan 14 09:45:13.938628 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 12/20] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:13 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1266 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:13.948863 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6c18acf0-5853-4af4-9ac6-a824dc89ec97 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd323fa6c10>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.025108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-26fd1afd-d4fa-4bdb-8161-ff5a2c6e4e48 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157104 Jan 14 09:45:14.026063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 9/21] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Jan 14 09:45:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:14.038319 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ce9af217-3f95-4004-ae0a-b96676db2ab8 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd322f504c0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.141878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6c18acf0-5853-4af4-9ac6-a824dc89ec97 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497" status: 202 len: 0 microversion: 2.1 time: 0.197479 Jan 14 09:45:14.142803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 13/22] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jan 14 09:45:13 2022] DELETE /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:45:14.151170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f8c37e5a-c1ff-4f24-a8b2-9f7e1a6704ac tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd324016ee0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.352137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ce9af217-3f95-4004-ae0a-b96676db2ab8 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.317627 Jan 14 09:45:14.353063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 10/23] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:14.364714 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1ec9f130-080b-46c4-99c3-1f3a43da5415 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd322f524c0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.413426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-f8c37e5a-c1ff-4f24-a8b2-9f7e1a6704ac tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] HTTP exception thrown: Volume abcf1368-b0b5-4a87-97c0-524ca23ab497 could not be found. Jan 14 09:45:14.414038 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f8c37e5a-c1ff-4f24-a8b2-9f7e1a6704ac tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Returning 404 to user: Volume abcf1368-b0b5-4a87-97c0-524ca23ab497 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:14.415123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f8c37e5a-c1ff-4f24-a8b2-9f7e1a6704ac tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497" status: 404 len: 109 microversion: 2.1 time: 0.267680 Jan 14 09:45:14.415741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 14/24] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497 => generated 109 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:45:14.424891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-181e3e10-68e1-4d71-8174-70ff7a6f4d52 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd3240169d0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.617490 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-181e3e10-68e1-4d71-8174-70ff7a6f4d52 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] HTTP exception thrown: Volume abcf1368-b0b5-4a87-97c0-524ca23ab497 could not be found. Jan 14 09:45:14.618096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-181e3e10-68e1-4d71-8174-70ff7a6f4d52 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Returning 404 to user: Volume abcf1368-b0b5-4a87-97c0-524ca23ab497 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:14.620394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1ec9f130-080b-46c4-99c3-1f3a43da5415 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.259864 Jan 14 09:45:14.621814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 11/25] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:45:14.623360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-181e3e10-68e1-4d71-8174-70ff7a6f4d52 tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497" status: 404 len: 109 microversion: 2.1 time: 0.200965 Jan 14 09:45:14.625993 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 15/26] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jan 14 09:45:14 2022] DELETE /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497 => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:45:14.637420 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b9a65a2f-2ad1-4138-a070-54aa8ea5b007 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd323fbf0d0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.639634 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8a2d7a8d-1138-4373-b4af-59d821149f6a tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Calling method '.version_select at 0x7fd322f52c10>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.705982 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-8a2d7a8d-1138-4373-b4af-59d821149f6a tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] HTTP exception thrown: Volume abcf1368-b0b5-4a87-97c0-524ca23ab497 could not be found. Jan 14 09:45:14.706635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8a2d7a8d-1138-4373-b4af-59d821149f6a tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] Returning 404 to user: Volume abcf1368-b0b5-4a87-97c0-524ca23ab497 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:14.708244 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8a2d7a8d-1138-4373-b4af-59d821149f6a tempest-VolumesSnapshotsTestJSON-1961298017 tempest-VolumesSnapshotsTestJSON-1961298017-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497" status: 404 len: 109 microversion: 2.1 time: 0.080142 Jan 14 09:45:14.709395 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 12/27] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/os-volumes/abcf1368-b0b5-4a87-97c0-524ca23ab497 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:45:14.832737 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b9a65a2f-2ad1-4138-a070-54aa8ea5b007 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.199759 Jan 14 09:45:14.835493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 16/28] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:14.847342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d37890c8-7fde-4c96-9fe8-7243d3d9220b tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd323fbcb80>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.962521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:14.963510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:14.979558 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:14.980051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:14.998536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:14.999203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:15.062219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d37890c8-7fde-4c96-9fe8-7243d3d9220b tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.218415 Jan 14 09:45:15.070390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 13/29] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:15.078798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fa1d2c78-ad2e-4254-8ddf-767b84fd3bdb tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd323fbcaf0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:15.321456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fa1d2c78-ad2e-4254-8ddf-767b84fd3bdb tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.247982 Jan 14 09:45:15.330918 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Jan 14 09:45:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:15.360588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2381bef4-d004-4590-b637-0c5b7d13d7d2 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] Calling method '.version_select at 0x7fd322f529d0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:15.666773 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2381bef4-d004-4590-b637-0c5b7d13d7d2 tempest-VolumesTestJSON-1800334191 tempest-VolumesTestJSON-1800334191-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.332925 Jan 14 09:45:15.667983 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jan 14 09:45:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:15.824779 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:15.839360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bc3ceca0-187e-4b06-8267-9df443c35d0c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1272 microversion: 2.1 time: 0.886842 Jan 14 09:45:15.851618 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:14 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1272 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:16.882380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:16.883037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:16.913981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:16.914483 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:16.915305 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:16.915753 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:17.637870 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:17.670031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ba3d7083-d0f3-4ea0-986d-80ef78c2de7a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1272 microversion: 2.1 time: 0.787783 Jan 14 09:45:17.672195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:16 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1272 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:18.705254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:18.705988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:18.714289 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:18.714768 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:18.727891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:18.728378 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:19.851632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:19.876648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d4026c9d-2df7-49f2-8ebb-404e733d9b12 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1272 microversion: 2.1 time: 1.178346 Jan 14 09:45:19.878011 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:18 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1272 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:20.895413 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:20.896664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:20.908225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:20.908670 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:20.909476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:20.909915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:21.340577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8b17c7c7-650e-49e0-b23f-622651232176 tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Action: 'create', calling method: .version_select at 0x7fd322edc310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1527955768", "metadata": {"Type": "work"}}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:21.399030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:21.407460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6ef266c6-476b-4bbb-88d4-d20a30afc1ad tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 0.516349 Jan 14 09:45:21.408023 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:20 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:22.371884 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8b17c7c7-650e-49e0-b23f-622651232176 tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.887447 Jan 14 09:45:22.373462 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 17/36] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jan 14 09:45:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1890 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 14 09:45:22.387801 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ffd691d4-754f-4dc1-9d94-20f93aa2b6a7 tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Calling method '.version_select at 0x7fd323f495e0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:22.428790 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:22.429855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:22.481862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:22.490826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:22.492821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:22.503855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:22.588254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ffd691d4-754f-4dc1-9d94-20f93aa2b6a7 tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8" status: 200 len: 353 microversion: 2.1 time: 0.206543 Jan 14 09:45:22.589681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 20/37] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:22 2022] GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:23.608689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-23a5929e-4a65-464a-a5fa-e4c8597bf797 tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Calling method '.version_select at 0x7fd323f850d0>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:23.714113 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-23a5929e-4a65-464a-a5fa-e4c8597bf797 tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8" status: 200 len: 354 microversion: 2.1 time: 0.116759 Jan 14 09:45:23.715391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 21/38] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:23 2022] GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:23.955724 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4b1196af-f0e1-4825-b44b-48deea765e25 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'create', calling method: .version_select at 0x7fd323f9f430>, body: {"keypair": {"name": "tempest-keypair-1607580148"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:24.048474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-4b1196af-f0e1-4825-b44b-48deea765e25 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:24.063775 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-4b1196af-f0e1-4825-b44b-48deea765e25 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for user 4d5195514db043518c76df657c40baa6 and project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:24.204658 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:24.222673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6d6f52fe-12b6-4501-8dc9-8720198de0c6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 1.798227 Jan 14 09:45:24.225575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 18/39] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:22 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:24.243731 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4bc53dad-8e41-4608-90a1-8b0444e5fd8d tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Calling method '.version_select at 0x7fd322ea4b80>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:24.487926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4bc53dad-8e41-4608-90a1-8b0444e5fd8d tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8" status: 200 len: 354 microversion: 2.1 time: 0.261096 Jan 14 09:45:24.500355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:24 2022] GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8 => generated 354 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:24.506323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9997b34a-4aa5-483c-b777-4f4c19621cef tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Calling method '.version_select at 0x7fd322eb2040>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:24.683013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9997b34a-4aa5-483c-b777-4f4c19621cef tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8" status: 202 len: 0 microversion: 2.1 time: 0.181414 Jan 14 09:45:24.683904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 20/41] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jan 14 09:45:24 2022] DELETE /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:45:24.827108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-e26f8b9e-5c91-43ae-84fd-26ccc7921f41 req-308a288f-46ab-448e-9b23-c1e42b6a09ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb06ab78-a932-4c33-ac7c-987f258831c9", "tag": "c7d667cc-b41b-4770-83b6-aaae94d05def"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:24.832588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:24.832588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:45:24.872260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-e26f8b9e-5c91-43ae-84fd-26ccc7921f41 req-308a288f-46ab-448e-9b23-c1e42b6a09ee service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:24.873814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-e26f8b9e-5c91-43ae-84fd-26ccc7921f41 req-308a288f-46ab-448e-9b23-c1e42b6a09ee service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:24.921780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-e26f8b9e-5c91-43ae-84fd-26ccc7921f41 req-308a288f-46ab-448e-9b23-c1e42b6a09ee service nova] Creating event network-changed:c7d667cc-b41b-4770-83b6-aaae94d05def for instance bb06ab78-a932-4c33-ac7c-987f258831c9 on hv-cinder-82160 Jan 14 09:45:24.923413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-e26f8b9e-5c91-43ae-84fd-26ccc7921f41 req-308a288f-46ab-448e-9b23-c1e42b6a09ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=128092) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 14 09:45:24.926163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:24.940981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:24.942539 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:24.943292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:24.979386 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.compute.rpcapi [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 14 09:45:24.981117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] Releasing lock "compute-rpcapi-router" {{(pid=128092) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 14 09:45:25.020121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-4b1196af-f0e1-4825-b44b-48deea765e25 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:25.028456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6f9e389b-8c1d-4e4f-b301-244f0dfa8dd6 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338628 Jan 14 09:45:25.030750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 21/42] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:25.033403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-4b1196af-f0e1-4825-b44b-48deea765e25 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for user 4d5195514db043518c76df657c40baa6 and project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:25.043391 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c6a12cc1-1449-4ff8-879d-d5f2cb269fcc tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Calling method '.version_select at 0x7fd322edcdc0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:25.061191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4b1196af-f0e1-4825-b44b-48deea765e25 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.344574 Jan 14 09:45:25.065747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 22/43] 10.222.0.48 () {62 vars in 1198 bytes} [Fri Jan 14 09:45:23 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1349 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 14 09:45:25.108613 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-c6a12cc1-1449-4ff8-879d-d5f2cb269fcc tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] HTTP exception thrown: Volume b7f8c192-ffba-44dd-a363-433a912fd7a8 could not be found. Jan 14 09:45:25.110558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c6a12cc1-1449-4ff8-879d-d5f2cb269fcc tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] Returning 404 to user: Volume b7f8c192-ffba-44dd-a363-433a912fd7a8 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:25.113450 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c6a12cc1-1449-4ff8-879d-d5f2cb269fcc tempest-VolumesGetTestJSON-646134547 tempest-VolumesGetTestJSON-646134547-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8" status: 404 len: 109 microversion: 2.1 time: 0.080323 Jan 14 09:45:25.114262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 22/44] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:25 2022] GET /compute/v2.1/os-volumes/b7f8c192-ffba-44dd-a363-433a912fd7a8 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:45:25.249668 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:25.250966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:25.266976 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:25.267429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:25.268235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:25.268679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:26.391197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:26.399579 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-880f1893-aa28-4608-93fa-1778315f95b2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 1.162823 Jan 14 09:45:26.406671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 23/45] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:25 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:26.984752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-671464490", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78a3ace0-1988-4ea4-bbaf-f5f723e32336"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:27.082191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] validate_networks() for [('78a3ace0-1988-4ea4-bbaf-f5f723e32336', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:45:28.120796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-385abb34-bb3f-436e-9453-d85fb9ded4e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: .version_select at 0x7fd3236e0280>, body: {"keypair": {"name": "tempest-keypair-1715281194"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:28.182198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-385abb34-bb3f-436e-9453-d85fb9ded4e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:28.208585 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-385abb34-bb3f-436e-9453-d85fb9ded4e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for user 6b960f20a01149e192c66b63f828c1b3 and project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:28.647556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:45:28.648020 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:45:28.648508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:45:28.648923 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:45:28.650032 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:45:28.682208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:28.682689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:28.683514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:28.701099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:28.798766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Getting quotas for project ae8097afd74a4ab39619485b26bdf483. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:28.814810 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Getting quotas for user 9d153ca82cde4b9d9bac9eb7d33793ad and project ae8097afd74a4ab39619485b26bdf483. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:28.821756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-385abb34-bb3f-436e-9453-d85fb9ded4e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:28.838385 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-385abb34-bb3f-436e-9453-d85fb9ded4e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for user 6b960f20a01149e192c66b63f828c1b3 and project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:28.874758 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-385abb34-bb3f-436e-9453-d85fb9ded4e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.683749 Jan 14 09:45:28.876514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:45:28.881033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:45:28.883784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Jan 14 09:45:27 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:28.890681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:28.898624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:28.908755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:28.911297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:28.915154 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:28.916728 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:29.146862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-16dd9d65-e85e-4009-a3ad-edbd5079b1e6 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.942458 Jan 14 09:45:29.147529 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:45:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 14 09:45:29.185813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-77313630-acba-42a5-92e1-d8fa8cbb824b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:29.190224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-77313630-acba-42a5-92e1-d8fa8cbb824b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:29.574901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:29.586547 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-41d6dfc0-7f2d-4c2a-830e-991b1757d15c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 0.699593 Jan 14 09:45:29.589180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:28 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:29.834796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-77313630-acba-42a5-92e1-d8fa8cbb824b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:29.856656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-77313630-acba-42a5-92e1-d8fa8cbb824b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1221 microversion: 2.1 time: 0.695656 Jan 14 09:45:29.864293 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 24/49] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:29 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1221 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:30.377163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1675495810", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78a3ace0-1988-4ea4-bbaf-f5f723e32336"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:30.612397 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:30.615010 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:30.643464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:30.646922 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:30.650774 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:30.653143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:30.721320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] validate_networks() for [('78a3ace0-1988-4ea4-bbaf-f5f723e32336', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:45:31.575581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:31.644636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9b1228fe-b1b5-4495-9cad-ad37278e4d88 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 1.039792 Jan 14 09:45:31.646566 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:30 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:32.681818 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:32.690745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:32.737346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:32.742645 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:32.761460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:32.762489 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:33.157563 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:33.174383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1ea6352a-23f8-494e-b1d5-e6c0bbd704c2 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 0.503029 Jan 14 09:45:33.177408 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 26/51] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:32 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:33.620596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-839520136", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4533a7b-1d3c-49a1-9516-8877ba93fca2"}], "security_groups": [{"name": "tempest-securitygroup--1694880778"}], "key_name": "tempest-keypair-1607580148", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:34.025035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] validate_networks() for [('e4533a7b-1d3c-49a1-9516-8877ba93fca2', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:45:34.767209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:45:34.767783 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:45:34.768106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:45:34.768514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:45:34.769007 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:45:34.805871 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:34.806324 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:34.807192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:34.807630 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:34.892886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Getting quotas for project ae8097afd74a4ab39619485b26bdf483. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:34.911525 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Getting quotas for user 9d153ca82cde4b9d9bac9eb7d33793ad and project ae8097afd74a4ab39619485b26bdf483. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:34.954737 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:45:34.959730 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:45:35.009478 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:45:35.011687 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:45:35.012372 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:45:35.012933 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:45:35.013541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:45:35.048583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:35.050032 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:35.051110 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:35.051901 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:35.090129 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for project d87879779a7049fa888526ce5a0bf552. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:35.096831 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for user 4d5195514db043518c76df657c40baa6 and project d87879779a7049fa888526ce5a0bf552. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:35.126270 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:45:35.130235 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:45:35.144009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0b9845ed-bf93-42c4-9d20-3042d373c03b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.780426 Jan 14 09:45:35.152749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:45:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:45:35.175226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:35.175966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:35.209280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:35.209765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:35.211373 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:35.211840 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:35.393538 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a21c76ee-cd74-40a7-9e32-b33de4fcabb5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.790130 Jan 14 09:45:35.400301 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 27/53] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jan 14 09:45:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 14 09:45:36.087421 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1f2dec0f-132e-4d0b-b29a-c0d38e0abd5c tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Action: 'create', calling method: .version_select at 0x7fd322e5dca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-414123442", "metadata": {"Type": "work"}}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:36.095323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1f2dec0f-132e-4d0b-b29a-c0d38e0abd5c tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:36.100115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1f2dec0f-132e-4d0b-b29a-c0d38e0abd5c tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.697968 Jan 14 09:45:36.110747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 28/54] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jan 14 09:45:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 710 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:45:36.136016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b7e0903c-abc0-4114-a2e6-3b6c2421a26e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:36.147077 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b7e0903c-abc0-4114-a2e6-3b6c2421a26e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:36.364327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b7e0903c-abc0-4114-a2e6-3b6c2421a26e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:36.377602 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b7e0903c-abc0-4114-a2e6-3b6c2421a26e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1222 microversion: 2.1 time: 0.262152 Jan 14 09:45:36.379125 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 29/55] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:36 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:36.392603 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-abf1052f-c90f-45c3-b10c-6045e4332ab2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:36.393623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-abf1052f-c90f-45c3-b10c-6045e4332ab2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:36.551030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-abf1052f-c90f-45c3-b10c-6045e4332ab2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:36.566006 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-abf1052f-c90f-45c3-b10c-6045e4332ab2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:36.588225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-abf1052f-c90f-45c3-b10c-6045e4332ab2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:36.589326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-abf1052f-c90f-45c3-b10c-6045e4332ab2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1281 microversion: 2.20 time: 0.206774 Jan 14 09:45:36.589932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 30/56] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:36 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:36.624877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-83d17749-2326-48c3-9c36-4158edaf771f tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Action: 'create', calling method: .version_select at 0x7fd322e30af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1885220925", "metadata": {"Type": "work"}}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:36.628291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-83d17749-2326-48c3-9c36-4158edaf771f tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:36.637565 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-83d17749-2326-48c3-9c36-4158edaf771f tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033874 Jan 14 09:45:36.638185 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 31/57] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jan 14 09:45:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:45:36.677006 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2c02b5f1-4679-45c0-8a02-d4612333a9a0 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Action: 'create', calling method: .version_select at 0x7fd322e195e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-187868096", "metadata": {"Type": "work"}}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:36.685561 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2c02b5f1-4679-45c0-8a02-d4612333a9a0 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:36.688214 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2c02b5f1-4679-45c0-8a02-d4612333a9a0 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030747 Jan 14 09:45:36.690235 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 32/58] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jan 14 09:45:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:45:36.711257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fbf42d56-b2d8-4d08-8312-335b78d9cfa8 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Calling method '.version_select at 0x7fd322e30790>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:37.048474 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-fbf42d56-b2d8-4d08-8312-335b78d9cfa8 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] HTTP exception thrown: Volume tempest-invalid-255330157 could not be found. Jan 14 09:45:37.050580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fbf42d56-b2d8-4d08-8312-335b78d9cfa8 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Returning 404 to user: Volume tempest-invalid-255330157 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:37.053223 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fbf42d56-b2d8-4d08-8312-335b78d9cfa8 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-255330157" status: 404 len: 98 microversion: 2.1 time: 0.352674 Jan 14 09:45:37.054706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 33/59] 10.222.0.48 () {58 vars in 1214 bytes} [Fri Jan 14 09:45:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-255330157 => generated 98 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 14 09:45:37.089948 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8fcc8f5d-b113-417a-9814-0d237a774c20 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.025323 Jan 14 09:45:37.095131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 34/60] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jan 14 09:45:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 14 09:45:37.109676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9bd7c4b0-d04b-4a82-a9a5-80d2e4a24856 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007655 Jan 14 09:45:37.115682 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 35/61] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Jan 14 09:45:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 14 09:45:37.140262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e6b27df6-94b4-4677-9046-be56bab52c93 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Calling method '.version_select at 0x7fd322ea4040>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:37.277960 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-e6b27df6-94b4-4677-9046-be56bab52c93 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] HTTP exception thrown: Volume f79aefac-c13c-4edc-9563-d56bcb0a24cb could not be found. Jan 14 09:45:37.279265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e6b27df6-94b4-4677-9046-be56bab52c93 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Returning 404 to user: Volume f79aefac-c13c-4edc-9563-d56bcb0a24cb could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:37.281064 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e6b27df6-94b4-4677-9046-be56bab52c93 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/f79aefac-c13c-4edc-9563-d56bcb0a24cb" status: 404 len: 109 microversion: 2.1 time: 0.158313 Jan 14 09:45:37.289503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 36/62] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jan 14 09:45:37 2022] DELETE /compute/v2.1/os-volumes/f79aefac-c13c-4edc-9563-d56bcb0a24cb => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:45:37.295035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cbd70550-bbaf-48b6-a72d-c11df6a31574 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Calling method '.version_select at 0x7fd322e229d0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:37.321515 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:37.334905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-939e5cb9-f76e-4d21-b0a7-ede7785cfe1c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 2.179704 Jan 14 09:45:37.352172 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 27/63] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:35 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:37.415827 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:37.416799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:37.443375 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:37.443844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:37.451315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:37.452205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:37.532897 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-cbd70550-bbaf-48b6-a72d-c11df6a31574 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] HTTP exception thrown: Volume c1627925-77b6-4be3-8a53-c1aea035514b could not be found. Jan 14 09:45:37.533489 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cbd70550-bbaf-48b6-a72d-c11df6a31574 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] Returning 404 to user: Volume c1627925-77b6-4be3-8a53-c1aea035514b could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:45:37.534381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-cbd70550-bbaf-48b6-a72d-c11df6a31574 tempest-VolumesNegativeTest-1611454503 tempest-VolumesNegativeTest-1611454503-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c1627925-77b6-4be3-8a53-c1aea035514b" status: 404 len: 109 microversion: 2.1 time: 0.243377 Jan 14 09:45:37.535920 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 37/64] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jan 14 09:45:37 2022] GET /compute/v2.1/os-volumes/c1627925-77b6-4be3-8a53-c1aea035514b => generated 109 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:45:37.610710 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:37.611660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:37.636034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:37.643047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:37.654568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:37.655120 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:37.945794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:37.958238 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:37.978679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0e3e71fd-d4e2-4ab0-8e8c-4c67115316f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1274 microversion: 2.1 time: 0.567752 Jan 14 09:45:37.988369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 28/65] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:37 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1274 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:37.994583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:37.999887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:38.009716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3e01028f-d43d-44c3-aaea-8ecea89951d4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1341 microversion: 2.20 time: 0.401682 Jan 14 09:45:38.014921 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 38/66] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:37 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1341 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:45:38.359913 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:38.360629 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:38.375915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:38.376460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:38.377652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:38.378198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:38.745720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2125239952", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af3523e0-4f7f-4d39-a66e-eb6ac45ad243"}], "security_groups": [{"name": "tempest-securitygroup--1198720804"}], "key_name": "tempest-keypair-1715281194", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:38.942270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:38.955648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cb6c8f60-5f56-484e-bb15-899f7e79c2a9 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 0.599348 Jan 14 09:45:38.957352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 29/67] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:38 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:39.028620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:39.029573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:39.037549 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.038487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.039658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.040249 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.163851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:39.178853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b2a6fc36-54ec-4419-ac74-6c8c6828ec5d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1280 microversion: 2.1 time: 0.161597 Jan 14 09:45:39.179854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 30/68] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:39 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:39.181041 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] validate_networks() for [('af3523e0-4f7f-4d39-a66e-eb6ac45ad243', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:45:39.195951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:39.198570 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:39.212213 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.215124 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.216002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.216663 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.406391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:39.442164 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:39.461803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:39.465478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d798578f-7e95-4235-ab18-24d7cae0bef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1339 microversion: 2.20 time: 0.279621 Jan 14 09:45:39.470285 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 31/69] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:39 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:39.716323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-c96a60d7-897d-40bd-8d37-2f5d503ea945 req-ebfe56dd-4d95-4faa-8017-2103961ee4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468932bd-d6e7-43a5-84f1-53cc479aa7b0", "tag": "fec053d0-2d6f-4bb9-a828-7e99bac5a9b7"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:39.718841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:39.718841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:45:39.739768 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c96a60d7-897d-40bd-8d37-2f5d503ea945 req-ebfe56dd-4d95-4faa-8017-2103961ee4f6 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.741426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c96a60d7-897d-40bd-8d37-2f5d503ea945 req-ebfe56dd-4d95-4faa-8017-2103961ee4f6 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.781526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-c96a60d7-897d-40bd-8d37-2f5d503ea945 req-ebfe56dd-4d95-4faa-8017-2103961ee4f6 service nova] Creating event network-changed:fec053d0-2d6f-4bb9-a828-7e99bac5a9b7 for instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 on hv-cinder-82160 Jan 14 09:45:39.782440 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c96a60d7-897d-40bd-8d37-2f5d503ea945 req-ebfe56dd-4d95-4faa-8017-2103961ee4f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128091) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 14 09:45:39.783768 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.784486 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.785577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:39.786253 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:39.797284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.compute.rpcapi [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 14 09:45:39.798803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] Releasing lock "compute-rpcapi-router" {{(pid=128091) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 14 09:45:39.851316 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9843ce0c-76ce-4ea2-8e28-9823e911f985 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133317 Jan 14 09:45:39.853102 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 32/70] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:45:39.987529 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:39.989479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:40.013227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:40.014174 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:40.015780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:40.016603 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:40.331537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:40.380732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2d7906f4-45f6-4138-9344-f3878d533487 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 0.400353 Jan 14 09:45:40.382765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 33/71] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:39 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:40.651369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-a726930f-70a8-4e52-9c1f-ec5837fb0242 req-2912860c-61d6-449b-88a7-92a841f0c826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb06ab78-a932-4c33-ac7c-987f258831c9", "name": "network-vif-plugged", "status": "completed", "tag": "c7d667cc-b41b-4770-83b6-aaae94d05def"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:40.655763 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:40.655763 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:45:40.669387 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-a726930f-70a8-4e52-9c1f-ec5837fb0242 req-2912860c-61d6-449b-88a7-92a841f0c826 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:40.670541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-a726930f-70a8-4e52-9c1f-ec5837fb0242 req-2912860c-61d6-449b-88a7-92a841f0c826 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:40.697503 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-a726930f-70a8-4e52-9c1f-ec5837fb0242 req-2912860c-61d6-449b-88a7-92a841f0c826 service nova] Creating event network-vif-plugged:c7d667cc-b41b-4770-83b6-aaae94d05def for instance bb06ab78-a932-4c33-ac7c-987f258831c9 on hv-cinder-82160 Jan 14 09:45:40.708579 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-a726930f-70a8-4e52-9c1f-ec5837fb0242 req-2912860c-61d6-449b-88a7-92a841f0c826 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322593 Jan 14 09:45:40.709670 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 34/72] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:40.720799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:40.721995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:40.734012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:40.735161 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:40.736684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:40.737473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:41.011381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:45:41.012042 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:45:41.013181 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:45:41.013889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:45:41.014657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:45:41.046511 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:41.047305 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:41.048805 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:41.049602 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:41.108156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:45:41.119662 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for user 6b960f20a01149e192c66b63f828c1b3 and project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:45:41.138076 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:41.148308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f4335fae-57fe-41df-9f20-75ebe2ba3b85 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 0.436598 Jan 14 09:45:41.150802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 35/73] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:40 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:41.158793 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:41.159796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:41.168105 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:45:41.169526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:41.172624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:45:41.179127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:41.180401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:41.181586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:41.360323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-67a8eb2b-d5ff-4762-91c5-679a2193819e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.618633 Jan 14 09:45:41.371257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 39/74] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:45:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:45:41.396691 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f1192aaa-b810-4c65-9d94-99a81be9888d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:41.397877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f1192aaa-b810-4c65-9d94-99a81be9888d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:41.655489 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f1192aaa-b810-4c65-9d94-99a81be9888d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:41.664145 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:41.667763 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f1192aaa-b810-4c65-9d94-99a81be9888d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1238 microversion: 2.1 time: 0.278545 Jan 14 09:45:41.675447 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:41.684864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 40/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:41 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1238 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:41.684864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:41.684864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:41.688033 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:41.690160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e16b37e7-0b6e-469d-889c-89daaa356292 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.538043 Jan 14 09:45:41.690795 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:41.691480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:41.691691 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 36/76] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:41 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:41.693047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:41.693769 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.184604 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:42.186039 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:42.221857 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:42.224081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.229072 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:42.232836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.564543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:42.578960 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cb37aba3-5242-4f1c-a05e-1c194c4ebf9b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 0.402229 Jan 14 09:45:42.579723 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 37/77] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:42 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:42.708413 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:42.708413 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:42.714905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:42.715715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.717449 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:42.718981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.858932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:42.876975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-236ca9c0-387d-40c7-a14a-2ca181797ab1 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 1.199446 Jan 14 09:45:42.886604 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 41/78] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:41 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:42.886604 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:42.886604 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:42.888181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:42.893248 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:42.893702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.894559 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:42.895041 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:42.924011 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-54c1a4c3-12fb-4fd0-b577-bf59208b6b7f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1242 microversion: 2.1 time: 0.233137 Jan 14 09:45:42.925130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 38/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:42 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:43.438586 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:43.449306 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:43.451406 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:43.452826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4089ec2b-9be9-4e6a-a417-fd79da723a44 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.573757 Jan 14 09:45:43.454061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 42/80] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:42 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:43.596743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:43.597370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:43.617901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:43.618814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:43.619852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:43.620544 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:43.919926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:43.921912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:43.964951 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:43.965784 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:43.967326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:43.976504 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:44.054117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:44.100702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c6c8ec99-86e0-4180-bc4e-8c3e0b141b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 0.507152 Jan 14 09:45:44.114331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 39/81] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:43 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:44.128965 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:44.135599 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:44.174458 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:44.176289 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:44.179681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:44.182322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:44.417752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:44.441361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-93d79abe-e63e-4766-80f3-c7e8fb2d85e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1242 microversion: 2.1 time: 0.324026 Jan 14 09:45:44.448610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 40/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:44 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1242 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:44.712076 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-aeab3038-cf60-4ead-b593-d452d7c85cdf req-a2862a78-203b-4979-8d3f-31faa4ec1368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:44.714377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:44.714377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:45:44.723607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-aeab3038-cf60-4ead-b593-d452d7c85cdf req-a2862a78-203b-4979-8d3f-31faa4ec1368 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:44.724848 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-aeab3038-cf60-4ead-b593-d452d7c85cdf req-a2862a78-203b-4979-8d3f-31faa4ec1368 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:44.740022 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-aeab3038-cf60-4ead-b593-d452d7c85cdf req-a2862a78-203b-4979-8d3f-31faa4ec1368 service nova] Creating event network-changed:7199b4e9-feda-4595-83c7-1a3f330de646 for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a on hv-cinder-82160 Jan 14 09:45:44.747067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-aeab3038-cf60-4ead-b593-d452d7c85cdf req-a2862a78-203b-4979-8d3f-31faa4ec1368 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294396 Jan 14 09:45:44.748814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 41/83] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:44.756312 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:44.757679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:44.767031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:44.767927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:44.768846 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:44.769394 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:45.527562 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:45.558565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:45.572613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:45.574029 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-93af6eb7-5a57-4fa4-b333-a59266a0242f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.823836 Jan 14 09:45:45.576057 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 42/84] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:44 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:45.590793 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:45.591470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:45.607937 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:45.609544 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:45.610696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:45.611248 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:45.611248 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:45.644703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-14a08159-6098-4e3e-a284-e9c4051cbf81 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 1.750418 Jan 14 09:45:45.647978 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:43 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:45.673550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:45.675480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:45.702241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:45.706026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:45.710365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:45.714218 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:45.937212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:45.975127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c9c63ebf-9b8c-4d89-bf62-626b59809be1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 0.397647 Jan 14 09:45:45.982392 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:45 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:46.093256 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:46.110106 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0f9e6ccb-a46f-42ab-aa8e-c690f3a35d40 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1296 microversion: 2.1 time: 0.457548 Jan 14 09:45:46.110731 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:45 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1296 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:46.602080 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:46.603748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:46.624915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:46.630851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:46.634004 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:46.637270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:46.668160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:46.671676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:46.685439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:46.687034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:46.689067 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:46.690128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:47.001435 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:47.059017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:47.064938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:47.076360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9ffb8367-9b94-4889-b855-99374247ba53 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.477250 Jan 14 09:45:47.086877 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 44/88] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:46 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:47.105611 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-6744a17c-64b3-49c5-96c6-e61fd759416d req-f707dff9-d716-4de3-aaa1-ab404bbe9180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc92076-08d2-4373-b753-89ccf31977b3", "tag": "5a23db63-64e3-4028-bc26-b6109dcd48ad"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:47.117371 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:47.117371 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:45:47.159813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:47.163235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-6744a17c-64b3-49c5-96c6-e61fd759416d req-f707dff9-d716-4de3-aaa1-ab404bbe9180 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:47.172506 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-6744a17c-64b3-49c5-96c6-e61fd759416d req-f707dff9-d716-4de3-aaa1-ab404bbe9180 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:47.185280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b2c85940-a3bb-4c71-985e-c27ef67aede4 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1314 microversion: 2.1 time: 0.523911 Jan 14 09:45:47.186793 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:46 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:47.201430 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:47.202131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:47.220757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:47.221213 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:47.222165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:47.223264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:47.241223 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-6744a17c-64b3-49c5-96c6-e61fd759416d req-f707dff9-d716-4de3-aaa1-ab404bbe9180 service nova] Creating event network-changed:5a23db63-64e3-4028-bc26-b6109dcd48ad for instance 4cc92076-08d2-4373-b753-89ccf31977b3 on hv-cinder-82160 Jan 14 09:45:47.261842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-6744a17c-64b3-49c5-96c6-e61fd759416d req-f707dff9-d716-4de3-aaa1-ab404bbe9180 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168479 Jan 14 09:45:47.284195 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 45/90] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:47.313256 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:47.316698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:47.334741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:47.342941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:47.345185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:47.346332 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:47.573450 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:47.613860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f6eeb64f-e23a-4785-977b-356510e153bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1296 microversion: 2.1 time: 0.321923 Jan 14 09:45:47.622427 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 46/91] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:47 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:48.125580 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:48.126668 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:48.157277 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:48.158843 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:48.160643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:48.161446 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:48.479604 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:48.497684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:48.499837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:48.501287 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cd01cb03-9d4d-4e97-94da-a43ad6f6d8a6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.382682 Jan 14 09:45:48.502028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 47/92] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:48 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:45:48.508638 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:48.509626 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:48.516635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:48.517428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:48.518588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:48.519265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:48.627889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:48.640472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4a0bcfee-47f9-43b3-88f9-03a1aae4c5e8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 1.452292 Jan 14 09:45:48.641568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 46/93] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:47 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:48.663706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:48.665385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:48.684863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:48.685417 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:48.690264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:48.691480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:48.971346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:48.986642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ad83fe54-78f7-4b5f-a9fe-b6e70dde4d2b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.342855 Jan 14 09:45:48.999456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 47/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:48 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:49.028827 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:49.053596 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e5f343e0-5313-493d-b23d-f83047ce02dd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1501 microversion: 2.1 time: 0.550157 Jan 14 09:45:49.055455 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 48/95] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:48 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1501 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:49.544501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:49.545676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:49.554888 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:49.555588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:49.556484 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:49.557337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:49.666694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:49.667462 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:49.701281 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:49.714151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:49.717138 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:49.718173 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:49.876436 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:49.893276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:49.898157 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:49.900549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-028ee93b-bf1d-4f5e-a30d-bf411c8ef81c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.362561 Jan 14 09:45:49.916807 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 48/96] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:49 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:50.015625 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:50.016437 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:50.033993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:50.034783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:50.039952 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:50.040692 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:50.047003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:50.070216 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-efea93f0-d65d-4487-abd6-3e1c7c1975ea tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 0.407376 Jan 14 09:45:50.086389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 49/97] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:49 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:50.378840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:50.399546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-263d28ad-36ca-4aa0-8fe3-bd9ed06067c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.389081 Jan 14 09:45:50.400605 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 49/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:50 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:50.929659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:50.930828 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:50.938311 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:50.939322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:50.940509 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:50.941029 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:51.101568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:51.103909 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:51.132989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:51.134121 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:51.135632 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:51.137689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:51.245730 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:51.257028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:51.258722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:51.259889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5d07fd7b-9a9f-4779-a59b-bc1587484efe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.334442 Jan 14 09:45:51.260739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 50/99] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:50 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:51.430305 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:51.431326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:51.446146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:51.447482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:51.448584 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:51.449114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:51.754525 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:51.775060 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8b3a30ea-10d8-4a8a-a451-f883387eb6f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.349231 Jan 14 09:45:51.779087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 51/100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:51 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:52.026931 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "683b9b92-5cf8-4bec-a528-2d268ac35e75"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:52.029921 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:52.047338 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:52.048725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:52.052654 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:52.057493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:52.465611 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:52.481224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-640c4d73-d301-43f3-a831-566a95095ec5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 1.387237 Jan 14 09:45:52.481830 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:51 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:52.504864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:52.505698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:52.541168 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:52.541631 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:52.542487 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:52.542928 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:53.015695 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:53.028871 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-773b4668-76c0-49bb-be3d-43139049ee80 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "POST /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007630 Jan 14 09:45:53.036721 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 52/102] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:45:52 2022] POST /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9/os-volume_attachments => generated 194 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:45:53.063748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:53.064184 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:53.070039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:53.071545 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:53.080809 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e639ce06-6987-4add-9243-0cccb6212f8e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.579906 Jan 14 09:45:53.084490 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 51/103] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:52 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:53.092838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:53.094575 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:53.096538 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:53.098009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:53.508359 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:53.514335 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:53.545605 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:53.546941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:53.548969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:53.550096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:53.741217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:53.787226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-197f7c1b-e509-46a3-aeda-2b04ac47dd0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.746651 Jan 14 09:45:53.788126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:53 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:53.868714 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-df13ad2a-e53f-4d1a-8eed-c11aa77777c6 req-beeb63ad-c541-4175-9ad3-95d8a8279f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280d074f-8581-4736-a953-d93b0e2f6c6d", "tag": "edf55d90-6fff-47ad-a60f-8c3f5d2f8f64"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:53.870276 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:53.870276 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:45:53.900220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-df13ad2a-e53f-4d1a-8eed-c11aa77777c6 req-beeb63ad-c541-4175-9ad3-95d8a8279f35 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:53.906890 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-df13ad2a-e53f-4d1a-8eed-c11aa77777c6 req-beeb63ad-c541-4175-9ad3-95d8a8279f35 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:53.969284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-df13ad2a-e53f-4d1a-8eed-c11aa77777c6 req-beeb63ad-c541-4175-9ad3-95d8a8279f35 service nova] Creating event network-changed:edf55d90-6fff-47ad-a60f-8c3f5d2f8f64 for instance 280d074f-8581-4736-a953-d93b0e2f6c6d on hv-cinder-82160 Jan 14 09:45:53.986403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-df13ad2a-e53f-4d1a-8eed-c11aa77777c6 req-beeb63ad-c541-4175-9ad3-95d8a8279f35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121689 Jan 14 09:45:53.987011 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 54/105] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:54.123166 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:54.130129 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:54.159168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:54.160307 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:54.165268 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:54.170025 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:54.460000 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:54.506577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b0c19aaa-bd9f-4f14-b2eb-e19c889d8c14 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 1.009669 Jan 14 09:45:54.530522 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 52/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:53 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:54.630047 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:54.652560 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:54.654158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:54.667103 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-88184ed2-13d7-4f13-9b25-2a8a08568a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.553272 Jan 14 09:45:54.667650 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 55/107] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:54 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:45:54.700554 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-37821c3d-994b-482e-9284-66d53cebc6f1 req-7ff1c647-8bf1-4b61-8678-743f3ebd6b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc92076-08d2-4373-b753-89ccf31977b3", "name": "network-vif-plugged", "status": "completed", "tag": "5a23db63-64e3-4028-bc26-b6109dcd48ad"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:54.702228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:54.702228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:45:54.719132 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-37821c3d-994b-482e-9284-66d53cebc6f1 req-7ff1c647-8bf1-4b61-8678-743f3ebd6b7b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:54.731130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-37821c3d-994b-482e-9284-66d53cebc6f1 req-7ff1c647-8bf1-4b61-8678-743f3ebd6b7b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:54.772314 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-37821c3d-994b-482e-9284-66d53cebc6f1 req-7ff1c647-8bf1-4b61-8678-743f3ebd6b7b service nova] Creating event network-vif-plugged:5a23db63-64e3-4028-bc26-b6109dcd48ad for instance 4cc92076-08d2-4373-b753-89ccf31977b3 on hv-cinder-82160 Jan 14 09:45:54.792994 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-37821c3d-994b-482e-9284-66d53cebc6f1 req-7ff1c647-8bf1-4b61-8678-743f3ebd6b7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096324 Jan 14 09:45:54.797241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 53/108] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:54.816423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:54.817060 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:54.829806 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:54.832443 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:54.836425 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:54.837123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:55.267136 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:55.304215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0fc98f03-1fa3-4f62-8857-9586b2f526af tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.491980 Jan 14 09:45:55.311222 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 56/109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:54 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:55.551404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:55.553030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:55.579724 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:55.581672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:55.585704 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:55.587217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:55.728578 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:55.735373 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:55.763419 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:55.764539 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:55.766108 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:55.767054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:56.027812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:56.043265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:56.046302 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:56.053343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cefca6d0-961e-483e-8877-6ef79b7913bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.330661 Jan 14 09:45:56.054700 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 57/110] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:55 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:56.082118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:56.102156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-402512a9-fac4-4667-859a-923c6d309375 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1322 microversion: 2.1 time: 0.556239 Jan 14 09:45:56.103878 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 54/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:55 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:56.326633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:56.328050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:56.335498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:56.337006 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:56.338055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:56.338685 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:56.596249 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:56.614928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ad278ba3-7abe-4cec-ac73-ad1fd96cbcf9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.291632 Jan 14 09:45:56.617740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 58/112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:56 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:57.092684 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:57.094912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:57.107381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.109353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.110210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.110756 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.121587 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:57.123114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:57.141498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.142258 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.144825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.158242 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.603798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:57.621868 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:57.625539 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:57.628020 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d5343337-1167-4439-829a-e8eca382e0e5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.541360 Jan 14 09:45:57.629979 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 55/113] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:57 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:57.637186 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-6a94d8c5-77eb-418a-97ff-942109e48df5 req-8ac80071-dfb8-43c2-bf20-3b8594e2d6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "name": "network-vif-plugged", "status": "completed", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:57.642996 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:57.642996 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:45:57.658274 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6a94d8c5-77eb-418a-97ff-942109e48df5 req-8ac80071-dfb8-43c2-bf20-3b8594e2d6e4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.661656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6a94d8c5-77eb-418a-97ff-942109e48df5 req-8ac80071-dfb8-43c2-bf20-3b8594e2d6e4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.686989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-6a94d8c5-77eb-418a-97ff-942109e48df5 req-8ac80071-dfb8-43c2-bf20-3b8594e2d6e4 service nova] Creating event network-vif-plugged:7199b4e9-feda-4595-83c7-1a3f330de646 for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a on hv-cinder-82160 Jan 14 09:45:57.702481 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-6a94d8c5-77eb-418a-97ff-942109e48df5 req-8ac80071-dfb8-43c2-bf20-3b8594e2d6e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069868 Jan 14 09:45:57.705716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 56/114] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:45:57.715460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:57.717311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:57.729879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:57.733296 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.734642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.744737 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-af8a1fec-5d9b-48d2-a40e-33248f72f55d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1516 microversion: 2.1 time: 0.627900 Jan 14 09:45:57.746209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 59/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:57 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1516 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:45:57.760388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.774034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.782367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:57.786646 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:57.800825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.801700 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.803139 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:57.804664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:57.851767 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lazy-loading 'flavor' on Instance uuid 4cc92076-08d2-4373-b753-89ccf31977b3 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:45:58.066895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2d05c3e0-602a-46af-ba95-d84c15eb5f03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3/action" status: 200 len: 32 microversion: 2.1 time: 0.292853 Jan 14 09:45:58.068590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 60/116] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:45:57 2022] POST /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 14 09:45:58.083834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:58.085018 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:58.122674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:58.124040 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:58.125736 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:58.128221 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:58.368908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:58.383603 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7bd3f09f-f0eb-4ec4-a324-a3988c8580f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.673112 Jan 14 09:45:58.393833 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 57/117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:57 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:58.465381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:58.481067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0fb6164f-3262-43aa-9a28-66039b3f1eaf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.405975 Jan 14 09:45:58.491672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 61/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:58 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:58.656063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:58.657257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:58.692706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:58.693171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:58.697119 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:58.697722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:59.004204 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:59.022752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:59.030098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:59.031790 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-97d6d69b-e7bc-4f7e-85bb-1bd211024154 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.386089 Jan 14 09:45:59.032718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 58/119] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:45:58 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:45:59.404909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:59.410689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:59.429334 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:59.430078 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:59.435411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:59.436220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:59.501806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:45:59.503713 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:45:59.517452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:59.521410 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:59.524140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:59.529094 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:59.731261 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:45:59.740192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8b62d153-4c3e-4b7d-8447-29fdad50a3e6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.342339 Jan 14 09:45:59.744121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 62/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:59 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:45:59.836128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-082bfd17-f504-4e3c-981c-2172c9279f26 req-ed4f652a-b13a-4e43-8b5d-de52c864fb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468932bd-d6e7-43a5-84f1-53cc479aa7b0", "name": "network-vif-plugged", "status": "completed", "tag": "fec053d0-2d6f-4bb9-a828-7e99bac5a9b7"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:45:59.844225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:45:59.844225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:45:59.878130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-082bfd17-f504-4e3c-981c-2172c9279f26 req-ed4f652a-b13a-4e43-8b5d-de52c864fb9e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:45:59.883498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-082bfd17-f504-4e3c-981c-2172c9279f26 req-ed4f652a-b13a-4e43-8b5d-de52c864fb9e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:45:59.934223 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-082bfd17-f504-4e3c-981c-2172c9279f26 req-ed4f652a-b13a-4e43-8b5d-de52c864fb9e service nova] Creating event network-vif-plugged:fec053d0-2d6f-4bb9-a828-7e99bac5a9b7 for instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 on hv-cinder-82160 Jan 14 09:45:59.945092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-082bfd17-f504-4e3c-981c-2172c9279f26 req-ed4f652a-b13a-4e43-8b5d-de52c864fb9e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133291 Jan 14 09:45:59.946264 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 63/121] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:00.053012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:00.053736 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:00.063390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:00.075532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:00.075992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:00.076508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a7c9e69e-c9cf-4474-b8d5-8eff9f696b35 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.578317 Jan 14 09:46:00.076839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:00.077293 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:00.084039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 59/122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:45:59 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:00.498836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:00.510996 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:00.515651 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:00.518005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-be5cd1b4-d91e-4486-83be-898284c60b9f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1407 microversion: 2.20 time: 0.469646 Jan 14 09:46:00.531731 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 64/123] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:46:00 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:46:00.768042 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:00.769737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:00.784829 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:00.787327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:00.788844 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:00.789595 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.108656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:01.109903 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:01.130069 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:01.154041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:01.154834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.156235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:01.156976 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.166669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9526b30d-b895-4da8-971b-3b07f755fc17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.408095 Jan 14 09:46:01.184785 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 60/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:00 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:01.468492 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:01.474920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f206c184-860a-47e2-a57b-c3ab5771cfcc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.374586 Jan 14 09:46:01.475562 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 65/125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:01 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:01.539404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:01.540449 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:01.547245 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:01.547577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.548224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:01.548961 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.806088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:01.829603 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:01.835118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:01.838761 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f3764efa-4371-4291-bd0a-c3adb838f177 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1598 microversion: 2.20 time: 0.302919 Jan 14 09:46:01.851665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 61/126] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:46:01 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1598 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:46:01.882445 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:01.883333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:01.903448 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:01.907909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.911533 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:01.917052 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:01.988389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-9b3fa64f-3d3d-4069-8a62-c117605c069d req-390496f1-375b-4fee-8663-1bff66fac3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280d074f-8581-4736-a953-d93b0e2f6c6d", "name": "network-vif-plugged", "status": "completed", "tag": "edf55d90-6fff-47ad-a60f-8c3f5d2f8f64"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:01.997831 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:01.997831 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:46:02.023534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-9b3fa64f-3d3d-4069-8a62-c117605c069d req-390496f1-375b-4fee-8663-1bff66fac3b1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:02.024636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-9b3fa64f-3d3d-4069-8a62-c117605c069d req-390496f1-375b-4fee-8663-1bff66fac3b1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:02.051142 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-9b3fa64f-3d3d-4069-8a62-c117605c069d req-390496f1-375b-4fee-8663-1bff66fac3b1 service nova] Creating event network-vif-plugged:edf55d90-6fff-47ad-a60f-8c3f5d2f8f64 for instance 280d074f-8581-4736-a953-d93b0e2f6c6d on hv-cinder-82160 Jan 14 09:46:02.063094 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-9b3fa64f-3d3d-4069-8a62-c117605c069d req-390496f1-375b-4fee-8663-1bff66fac3b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081795 Jan 14 09:46:02.064724 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 62/127] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:46:02.200571 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:02.201668 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:02.210841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:02.211434 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:02.212531 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:02.213775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:02.349659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9c7f6c19-0841-4685-8679-602bc844f8eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.477496 Jan 14 09:46:02.351196 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 66/128] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jan 14 09:46:01 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-interface => generated 284 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:02.524317 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:02.525692 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:02.537301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:02.538141 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:02.539682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:02.540551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:02.966589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:02.978086 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-81791672-58b0-4bc4-b787-4cc15d896d3d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.781434 Jan 14 09:46:02.981353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 63/129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:02 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:03.022527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:03.050033 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-43151ba0-0085-4f4b-94b5-d58fb2b8e29b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.542713 Jan 14 09:46:03.075956 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 67/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:02 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:03.297424 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:03.298980 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:03.312201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:03.313439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:03.315091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:03.316652 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:03.389443 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:46:03.672346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-caca51c2-e887-4e34-a3df-b637a155212c tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 204 len: 0 microversion: 2.1 time: 0.381754 Jan 14 09:46:03.674201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 64/131] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:46:03 2022] DELETE /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:46:03.683710 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:03.684457 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:03.694187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:03.694962 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:03.696166 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:03.696963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:03.872290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:03.882918 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-72789716-8ef2-40dd-bee4-60660ce762b6 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1553 microversion: 2.1 time: 0.203260 Jan 14 09:46:03.883771 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 68/132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:03 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:04.003878 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:04.006377 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:04.017824 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:04.019314 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:04.022001 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:04.025231 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:04.085633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:04.088887 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:04.103832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:04.104440 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:04.106260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:04.107666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:04.528125 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:04.545118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fbd21d58-6d23-40b1-979e-83b0b09ddc73 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.465478 Jan 14 09:46:04.547953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:04.558181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 69/133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:04 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:04.572546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1435e0ef-a890-49fd-ab22-15cdbad6ec5a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1364 microversion: 2.1 time: 0.574103 Jan 14 09:46:04.573526 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:03 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1364 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:04.907934 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:04.910092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:04.925295 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:04.926905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:04.928631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:04.929873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:05.266935 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:05.288906 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c8653fe6-3cda-402d-b79c-34e2333cc9f5 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1553 microversion: 2.1 time: 0.390513 Jan 14 09:46:05.291528 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 70/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:04 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1553 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:05.580729 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:05.584316 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:05.596211 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:05.599036 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:05.607871 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:05.608690 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:05.614745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:05.616884 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:05.647567 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:05.649473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:05.659045 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:05.661610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.028801 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:06.052964 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e31b6494-901e-4abb-b8fc-416dba959e33 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.479379 Jan 14 09:46:06.057606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 66/136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:05 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:06.059796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:06.081925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a171c204-60fa-4cae-b3e4-5c8bf6723f9e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1549 microversion: 2.1 time: 0.492131 Jan 14 09:46:06.084324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:06.086147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:06.092541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 71/137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:05 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1549 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:06.102823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.103487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-391238c7-95f5-41a9-9b6e-62a9c2fe0427 req-53a801da-53a2-4901-96dc-53c4f3312300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:06.107641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:06.107641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:46:06.108370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.110101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.114217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.121595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-391238c7-95f5-41a9-9b6e-62a9c2fe0427 req-53a801da-53a2-4901-96dc-53c4f3312300 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.122409 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-391238c7-95f5-41a9-9b6e-62a9c2fe0427 req-53a801da-53a2-4901-96dc-53c4f3312300 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.154605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-391238c7-95f5-41a9-9b6e-62a9c2fe0427 req-53a801da-53a2-4901-96dc-53c4f3312300 service nova] Creating event network-changed:7199b4e9-feda-4595-83c7-1a3f330de646 for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a on hv-cinder-82160 Jan 14 09:46:06.180498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-391238c7-95f5-41a9-9b6e-62a9c2fe0427 req-53a801da-53a2-4901-96dc-53c4f3312300 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084098 Jan 14 09:46:06.181393 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 72/138] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:06.210144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:06.211666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:06.231733 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.232840 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.234509 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.235380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.271971 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0a5a9b65-ce7a-4b34-979d-cc07bb6e0348 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 14 microversion: 2.20 time: 0.207922 Jan 14 09:46:06.276327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 67/139] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:06 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:06.322496 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:06.329320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:06.351433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.356656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.357757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:06.358823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:06.483845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-023bc164-6720-42ce-b046-fac6b94a6faf tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291269 Jan 14 09:46:06.485270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 73/140] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jan 14 09:46:06 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:07.038582 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:07.074177 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1f8278e8-5175-4133-b29f-d38ac145e08a tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1553 microversion: 2.1 time: 0.764167 Jan 14 09:46:07.076052 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:06 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1553 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:07.088468 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:07.089756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:07.106184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:07.117476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:07.119360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:07.122326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:07.292940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:07.325216 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:07.363486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:07.369227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:07.376879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:07.377433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:07.799549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5e0a92cf-1b1e-49da-90d0-684bdf15b2f6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 14 microversion: 2.20 time: 0.513320 Jan 14 09:46:07.801215 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 69/142] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:07 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 14 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:08.094921 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:08.097597 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:08.115321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:08.116774 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:08.117855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:08.118588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:08.247297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:08.278331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-83308f02-746e-48a0-85cf-f3348cd55d3a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 1.205551 Jan 14 09:46:08.287551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 74/143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:07 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:08.757761 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:08.770519 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5f726213-a61f-490a-9148-fa50977d4722 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1553 microversion: 2.1 time: 0.678459 Jan 14 09:46:08.783143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 70/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:08 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1553 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:08.827577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:08.837126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:08.862074 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:08.868460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:08.872821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:08.877524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.052034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8b0e3873-0f8d-4ed5-a945-c0f74c97afed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 14 microversion: 2.20 time: 0.228869 Jan 14 09:46:09.057742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 75/145] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:08 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:09.192278 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-6b6addb7-f79b-437b-8471-fe485b6a4b26 req-5153b649-37af-4cf3-adb0-4dc13ec9d33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb06ab78-a932-4c33-ac7c-987f258831c9", "name": "network-vif-deleted", "tag": "c7d667cc-b41b-4770-83b6-aaae94d05def"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:09.194107 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:09.194107 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:46:09.210719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6b6addb7-f79b-437b-8471-fe485b6a4b26 req-5153b649-37af-4cf3-adb0-4dc13ec9d33b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.215750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6b6addb7-f79b-437b-8471-fe485b6a4b26 req-5153b649-37af-4cf3-adb0-4dc13ec9d33b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.233492 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-6b6addb7-f79b-437b-8471-fe485b6a4b26 req-5153b649-37af-4cf3-adb0-4dc13ec9d33b service nova] Creating event network-vif-deleted:c7d667cc-b41b-4770-83b6-aaae94d05def for instance bb06ab78-a932-4c33-ac7c-987f258831c9 on hv-cinder-82160 Jan 14 09:46:09.242221 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-6b6addb7-f79b-437b-8471-fe485b6a4b26 req-5153b649-37af-4cf3-adb0-4dc13ec9d33b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053684 Jan 14 09:46:09.247851 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 71/146] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:09.330903 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:09.339770 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:09.353909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.355113 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.356841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.360752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.768172 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:09.789878 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:09.790988 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:09.793639 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0cca2103-3f74-4293-ac6f-049efdbd269d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.481574 Jan 14 09:46:09.813238 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 76/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:09 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:09.819175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.819786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.821092 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.829465 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.830672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:09.834223 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:09.847645 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.849214 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.851121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.852274 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.971005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-adacd9ba-4fb5-4fee-8dbf-573d9fff667c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 14 microversion: 2.1 time: 0.154685 Jan 14 09:46:09.972785 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:09.973078 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 77/148] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:09 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:46:09.975037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:09.975794 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lazy-loading 'fault' on Instance uuid bb06ab78-a932-4c33-ac7c-987f258831c9 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:46:09.991994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-0b29deb8-fce4-497c-b41e-48651fe181c4 req-ac114600-23a7-43a3-a7c2-3f2e228874c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280d074f-8581-4736-a953-d93b0e2f6c6d", "tag": "edf55d90-6fff-47ad-a60f-8c3f5d2f8f64"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:09.991994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:09.991994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:46:10.028603 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-0b29deb8-fce4-497c-b41e-48651fe181c4 req-ac114600-23a7-43a3-a7c2-3f2e228874c7 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:10.031705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-0b29deb8-fce4-497c-b41e-48651fe181c4 req-ac114600-23a7-43a3-a7c2-3f2e228874c7 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:10.106139 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a23d840c9249809fa7c8a7b0afeabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5d5139bc44adcb0fe4ddddf73580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:10.116033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2069e9b2-7870-4022-ad96-58178f22cd9d tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 200 len: 1350 microversion: 2.1 time: 0.331337 Jan 14 09:46:10.116710 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 72/149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:09 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 1350 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:10.126634 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-0b29deb8-fce4-497c-b41e-48651fe181c4 req-ac114600-23a7-43a3-a7c2-3f2e228874c7 service nova] Creating event network-changed:edf55d90-6fff-47ad-a60f-8c3f5d2f8f64 for instance 280d074f-8581-4736-a953-d93b0e2f6c6d on hv-cinder-82160 Jan 14 09:46:10.142526 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:10.150863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:10.156795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-0b29deb8-fce4-497c-b41e-48651fe181c4 req-ac114600-23a7-43a3-a7c2-3f2e228874c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175656 Jan 14 09:46:10.161917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 78/150] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:10.165962 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:10.166447 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:10.172580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:10.173480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:10.290013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7246e318-2afe-49ca-9222-4133dcf252dc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 14 microversion: 2.20 time: 0.172020 Jan 14 09:46:10.291052 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 73/151] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:10 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:10.836605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:10.843461 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:10.858735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:10.859895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:10.862118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:10.863096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:10.984337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:10.985540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:10.993339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:10.993786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.015822 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.016530 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.142816 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1c22b787-7d28-4908-9da6-27056ec9e466 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 14 microversion: 2.1 time: 0.162415 Jan 14 09:46:11.143508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 74/152] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:10 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 14 09:46:11.150243 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:11.151193 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:11.166491 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.167331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.168383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.169057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.199882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] HTTP exception thrown: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. Jan 14 09:46:11.201736 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Returning 404 to user: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:46:11.203624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-64ec96dd-8db7-4b67-af68-a7fc31f73781 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 404 len: 111 microversion: 2.1 time: 0.058451 Jan 14 09:46:11.206217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 75/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:11 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:46:11.264889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:11.309509 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:11.311147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:11.313844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f140e8b4-962b-46d5-948f-1c7c3a835c97 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.465206 Jan 14 09:46:11.315001 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 79/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:10 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:11.337355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.338090 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.340335 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.341160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.495955 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:11.497735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:11.512637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.514008 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.516299 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:11.517457 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:11.570593 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] HTTP exception thrown: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. Jan 14 09:46:11.571699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Returning 404 to user: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:46:11.575911 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d8bde37b-711f-4733-87ba-15d549364bfd tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086828 Jan 14 09:46:11.576626 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 80/155] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:46:11 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:46:12.159697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:12.161352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:12.172838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:12.173981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:12.176047 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:12.177223 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:13.853795 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fb60bfe9-aa7d-4dd2-bf5d-57405ae8e213 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 14 microversion: 2.20 time: 2.553870 Jan 14 09:46:13.855148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 76/156] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:11 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 14 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:13.861137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:13.861349 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:13.870380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:13.871226 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:13.872380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:13.872986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:13.886448 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5f63eb05-3e36-4f66-999f-82cf1e678cd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 14 microversion: 2.1 time: 1.733090 Jan 14 09:46:13.887644 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 81/157] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:12 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 14 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:46:14.473139 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:14.495255 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4b30124b-992d-4b6e-90ba-ee71a9969632 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.638545 Jan 14 09:46:14.497117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 77/158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:13 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:14.874469 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:14.878302 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:14.899219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:14.899777 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:14.900233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:14.901259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:14.901692 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:14.902511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:14.921111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:14.921550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:14.922479 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:14.923129 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:17.694130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ac4bae8e-1f74-471b-b7bc-96c858986ea7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 15025 microversion: 2.20 time: 2.829073 Jan 14 09:46:17.695799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 82/159] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:14 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 15025 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:17.702486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2368f57b-6a38-4744-9854-a737891a774b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 14 microversion: 2.1 time: 2.802789 Jan 14 09:46:17.703351 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:17.704296 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 78/160] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:14 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 14 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:46:17.704563 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:17.715318 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:17.715864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:17.716761 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:17.717370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:17.899910 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:17.914428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d70f8c83-c3e3-4f72-9fec-86973c6bb36e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.216901 Jan 14 09:46:17.915339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 83/161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:17 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:18.285956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:18.286733 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:18.297725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.298960 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.301012 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.302232 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.327144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] HTTP exception thrown: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. Jan 14 09:46:18.328115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Returning 404 to user: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:46:18.329374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e7060c30-f3d2-474a-8c23-b915bdbcf441 tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 404 len: 111 microversion: 2.1 time: 0.051439 Jan 14 09:46:18.330232 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:46:18 2022] DELETE /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:46:18.344446 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:18.345554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] [instance: bb06ab78-a932-4c33-ac7c-987f258831c9] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:18.360036 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.360750 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.362494 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.366778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.403879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] HTTP exception thrown: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. Jan 14 09:46:18.405279 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] Returning 404 to user: Instance bb06ab78-a932-4c33-ac7c-987f258831c9 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:46:18.407218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cd49ab95-f348-4a04-a472-807c584878ff tempest-DeleteServersTestJSON-1795409347 tempest-DeleteServersTestJSON-1795409347-project] 10.222.0.48 "GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9" status: 404 len: 111 microversion: 2.1 time: 0.069888 Jan 14 09:46:18.408497 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 84/163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:18 2022] GET /compute/v2.1/servers/bb06ab78-a932-4c33-ac7c-987f258831c9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:46:18.731196 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:18.732137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:18.734491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:18.739426 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:18.763527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.765424 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.765876 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.768936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.771483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.773353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.774220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.777569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.897277 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4eed77f4-b50a-41de-ae60-a1cf5eebbee2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 14 microversion: 2.1 time: 0.181224 Jan 14 09:46:18.898706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 85/164] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:18 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:46:18.928304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-25eb66f5-11d1-4ffb-99c6-59a492591444 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 17861 microversion: 2.20 time: 0.220398 Jan 14 09:46:18.931418 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 80/165] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:18 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 17861 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:46:18.952645 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:18.954796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:18.992947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.995068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:18.997219 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:18.998249 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:19.046549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-890840440", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:19.146296 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] validate_networks() for None {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:46:19.306212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:19.334093 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-84b1e38c-3146-4967-a234-df1e2b571e6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.394929 Jan 14 09:46:19.335111 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 86/166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:18 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:19.593388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:46:19.593821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:46:19.594617 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:46:19.594775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:46:19.595154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:46:19.609543 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:19.611056 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:19.612802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:19.613910 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:19.647720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Getting quotas for project 36e00a0e74f2414b9dd568f991ebe1a3. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:46:19.656848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Getting quotas for user da4fd71f0fd54e16b8a9d7281985170f and project 36e00a0e74f2414b9dd568f991ebe1a3. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:46:19.674290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:46:19.678650 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:46:19.763463 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5dd9d4f4-fb12-4cb4-b570-fd8267c296e4 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723996 Jan 14 09:46:19.767493 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 81/167] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:46:19.806001 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-620cce47-9019-4691-8e71-8d42e61d278c tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:19.807853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-620cce47-9019-4691-8e71-8d42e61d278c tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:19.912499 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:19.913685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:19.929209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:19.929756 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:19.931776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:19.932328 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:19.975936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-620cce47-9019-4691-8e71-8d42e61d278c tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:20.000947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-620cce47-9019-4691-8e71-8d42e61d278c tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1214 microversion: 2.1 time: 0.224575 Jan 14 09:46:20.005719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 87/168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:19 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:20.021984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:20.030191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c1cc0e67-f54e-4939-949c-6716d4af4a6c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 6451 microversion: 2.1 time: 0.122144 Jan 14 09:46:20.032023 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:20.032357 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 82/169] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:19 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 6451 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:20.069310 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:20.075473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:20.077149 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:20.078117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:20.208622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-516a7713-42fb-4ee9-bd9a-b6644ba7926c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 18663 microversion: 2.20 time: 0.200538 Jan 14 09:46:20.209332 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 88/170] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:20 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 18663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:20.353283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:20.354008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:20.366822 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:20.369941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:20.372573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:20.376031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:20.798279 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:20.821814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5cc6b1f3-3d5a-4e40-9f60-f1ee40368516 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.471748 Jan 14 09:46:20.825202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:20 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:21.028248 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:21.029460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:21.054679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.054679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.054679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.055109 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.058732 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:21.061194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:21.076684 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.080106 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.090043 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.092068 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.170183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:21.192776 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-36ce2308-c683-47f6-899b-fe1f03bd5f0f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1266 microversion: 2.1 time: 0.168057 Jan 14 09:46:21.193996 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 89/172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:21 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:21.229075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:21.232353 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:21.251304 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.252326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.254514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.255938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.263310 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-09715153-9619-4b3e-8399-1a86fbfcaf11 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 13651 microversion: 2.1 time: 0.221866 Jan 14 09:46:21.271369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 84/173] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:21 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 13651 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:46:21.401741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d695f7aa-3576-481d-84bd-c721db54633d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 20991 microversion: 2.20 time: 0.183793 Jan 14 09:46:21.403197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 90/174] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:21 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 20991 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:21.854320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:21.855103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:21.871217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.871531 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:21.874079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:21.874580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.204236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:22.225039 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:22.225039 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:22.227603 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1c180256-7af3-4fee-9dfd-aeabfe556fe9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.378034 Jan 14 09:46:22.228206 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 85/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:21 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:22.232047 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:22.233464 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.235229 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:22.238515 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.282039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:22.283722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:22.294217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:22.295031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.296087 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:22.296720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.385375 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-49cc3e7c-9ffc-4a3c-b5d2-d932d15ae86e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 18305 microversion: 2.1 time: 0.106972 Jan 14 09:46:22.386381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 86/176] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:22 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 18305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:46:22.413442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:22.420556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:22.421570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:22.434685 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8a5f4270-8c7b-4899-bcab-820a18b1d275 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1272 microversion: 2.1 time: 0.218901 Jan 14 09:46:22.435552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 91/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:22 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:22.444404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:22.446779 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.451203 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:22.451911 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:22.536744 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-522e4d2a-5e04-45ed-b9f2-52fb219f261f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 22540 microversion: 2.20 time: 0.126321 Jan 14 09:46:22.539552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 87/178] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:22 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 22540 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:23.253382 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:23.255153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:23.266520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.268300 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.270099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.271118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.399985 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:23.401020 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:23.425754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.427290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.433091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.436887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.583299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ebc3af34-c308-4554-8b89-8b873f84e3f4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 19342 microversion: 2.1 time: 0.186801 Jan 14 09:46:23.590202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 88/179] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:23 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 19342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:46:23.600883 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:23.604380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:23.621684 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.624616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.626094 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.627772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.713418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:23.727159 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0c494480-81ce-4d98-ac27-88e4f35ae3fb tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.477796 Jan 14 09:46:23.728146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 92/180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:23 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:23.738776 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:23.740364 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:23.752744 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.753916 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.756047 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:23.757045 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:23.858190 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e6452180-f286-4b22-851f-0adb24c079f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 24241 microversion: 2.20 time: 0.127900 Jan 14 09:46:23.860082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 93/181] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:23 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 24241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:23.980210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:23.994397 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6432e9d4-40a6-4df1-b76b-ca3a3e139f93 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.402844 Jan 14 09:46:23.995877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 89/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:23 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:24.490158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-4b1f83c4-d99f-480f-bd86-3b600bcd0790 req-3eb8e76d-4d65-479b-9af0-8f288c40e62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b336a5-cb5b-4c67-a622-38e19ab3e072", "tag": "3e490279-0871-49bf-b2a7-35bd468d9846"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:24.492551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:24.492551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:46:24.506711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-4b1f83c4-d99f-480f-bd86-3b600bcd0790 req-3eb8e76d-4d65-479b-9af0-8f288c40e62b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.507155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-4b1f83c4-d99f-480f-bd86-3b600bcd0790 req-3eb8e76d-4d65-479b-9af0-8f288c40e62b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:24.554126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-4b1f83c4-d99f-480f-bd86-3b600bcd0790 req-3eb8e76d-4d65-479b-9af0-8f288c40e62b service nova] Creating event network-changed:3e490279-0871-49bf-b2a7-35bd468d9846 for instance b5b336a5-cb5b-4c67-a622-38e19ab3e072 on hv-cinder-82160 Jan 14 09:46:24.561478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-4b1f83c4-d99f-480f-bd86-3b600bcd0790 req-3eb8e76d-4d65-479b-9af0-8f288c40e62b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076600 Jan 14 09:46:24.567145 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 94/183] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:24.605467 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:24.608336 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:24.628693 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.629738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:24.631964 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.632959 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:24.749976 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:24.751266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:24.769345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.775339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e6aaacf8-638e-4954-aede-80219ff0c42c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 21282 microversion: 2.1 time: 0.182575 Jan 14 09:46:24.776476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:24.780510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 90/184] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:24 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 21282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:24.781345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.782128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:24.875631 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:24.878198 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:24.892000 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.893768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:24.895547 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:24.896590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:25.018848 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:25.025476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8aa484d9-08d1-4016-9f09-aa1397955076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 25276 microversion: 2.20 time: 0.157289 Jan 14 09:46:25.026943 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 91/185] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:24 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 25276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:25.033394 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-37848fae-dae1-4265-be68-46fd4cdf57e9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.290978 Jan 14 09:46:25.034081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 95/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:24 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:25.043010 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:25.044100 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:25.057396 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:25.058060 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:25.059061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:25.059619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:25.326737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:25.341128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bc355671-47f9-4861-ac4a-de01b90c8b1e tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.302661 Jan 14 09:46:25.342270 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 92/187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:25 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:25.791176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:25.793378 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:25.804500 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:25.805513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:25.806902 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:25.807891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:25.925706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c3334bed-67e5-4487-aec8-02ec6e741226 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 22890 microversion: 2.1 time: 0.139704 Jan 14 09:46:25.936729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 96/188] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:25 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 22890 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:26.041190 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:26.043679 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:26.057493 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.058771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.060686 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.061384 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.069325 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:26.070679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:26.089754 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.090978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.093472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.094606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.171666 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-915dd4f3-9bf7-4d2d-afa9-a48b6c190249 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 26363 microversion: 2.20 time: 0.132703 Jan 14 09:46:26.175205 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 93/189] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:26 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 26363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:46:26.361815 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:26.362251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:26.364913 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:26.382099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.383475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.384772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.385583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.405162 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f959bde5-5185-4230-8699-308d3c62dbec tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.345392 Jan 14 09:46:26.415075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 97/190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:26 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:26.686163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:26.695672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6d4db728-882c-4366-86ae-3f45c2b2872a tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.339079 Jan 14 09:46:26.696771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 94/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:26 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:26.945919 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:26.947710 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:26.954686 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.955259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:26.956090 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:26.956541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:27.184765 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:27.185968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:27.194781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:27.195371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:27.196369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:27.197002 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:29.241064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f4bc57e1-baa0-43fc-a6fe-1d46efb57f9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 26200 microversion: 2.1 time: 2.301614 Jan 14 09:46:29.243070 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 98/192] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:26 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 26200 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:29.255137 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:29.256678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:29.269916 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:29.271177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:29.272948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:29.273983 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:29.293921 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b4b4a067-5f78-4bf9-aadf-7effecb8c976 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 27640 microversion: 2.20 time: 2.113588 Jan 14 09:46:29.294799 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 95/193] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:27 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 27640 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:29.300008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:29.303509 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:29.313467 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:29.314194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:29.315715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:29.316412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:29.521635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:29.542909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b335e56b-be7c-4f40-b4f0-33d29d1571d4 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.295698 Jan 14 09:46:29.545082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 99/194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:29 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:29.631862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:29.652111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c0373014-4e89-4349-a513-b9d958e0d479 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.355664 Jan 14 09:46:29.662495 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 96/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:29 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:30.261329 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:30.266437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:30.289073 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.289588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.293543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.294210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.309411 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:30.311260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:30.332144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.333840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.339197 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.343405 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.427161 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b07b8fff-f730-4b9e-8c97-bc23d91c54df tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 27028 microversion: 2.1 time: 0.173830 Jan 14 09:46:30.428551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 100/196] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:30 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 27028 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:30.532356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d69d18d6-efda-4e88-8662-8ce3d93a1282 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28045 microversion: 2.20 time: 0.228257 Jan 14 09:46:30.533473 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 97/197] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:30 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28045 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:46:30.576804 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:30.577513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:30.593157 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.594547 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.596391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.597538 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.670745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:30.671638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:30.690695 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.691154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.691963 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:30.692462 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:30.845286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:30.855852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-df6cf3d5-404a-4cd2-b03a-fa50cc9e83d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.283742 Jan 14 09:46:30.857019 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 101/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:30 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:30.954816 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:30.982059 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fefce072-7778-4163-8fe4-beb446b6c4d1 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.316157 Jan 14 09:46:30.983427 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 98/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:30 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:31.451170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:31.453111 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:31.481832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.483061 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:31.484869 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.485948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:31.555022 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:31.560488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:31.606371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.607217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:31.611527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.611830 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-18a1b32d-87fd-4eea-b84b-8c03547d5505 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 27554 microversion: 2.1 time: 0.170933 Jan 14 09:46:31.614004 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 102/200] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:31 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 27554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:31.617271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:31.630131 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-90719930-b9ca-422a-838a-c8734cb1dc4c req-d54b989f-3488-45d9-8012-7f09414f2be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b336a5-cb5b-4c67-a622-38e19ab3e072", "name": "network-vif-plugged", "status": "completed", "tag": "3e490279-0871-49bf-b2a7-35bd468d9846"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:31.637470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:31.637470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:46:31.682419 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-90719930-b9ca-422a-838a-c8734cb1dc4c req-d54b989f-3488-45d9-8012-7f09414f2be4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.693587 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-90719930-b9ca-422a-838a-c8734cb1dc4c req-d54b989f-3488-45d9-8012-7f09414f2be4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:31.732260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-90719930-b9ca-422a-838a-c8734cb1dc4c req-d54b989f-3488-45d9-8012-7f09414f2be4 service nova] Creating event network-vif-plugged:3e490279-0871-49bf-b2a7-35bd468d9846 for instance b5b336a5-cb5b-4c67-a622-38e19ab3e072 on hv-cinder-82160 Jan 14 09:46:31.740115 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-90719930-b9ca-422a-838a-c8734cb1dc4c req-d54b989f-3488-45d9-8012-7f09414f2be4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123850 Jan 14 09:46:31.740732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 103/201] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:31.797772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bf1bebc1-c4ad-4e7c-a3b3-753f490407da tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28173 microversion: 2.20 time: 0.246561 Jan 14 09:46:31.797772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 99/202] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:31 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28173 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:31.889303 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:31.890547 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:31.918747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.919517 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:31.920916 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:31.925071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.016246 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:32.017638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:32.056649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:32.057969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.059936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:32.061551 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.413648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:32.438506 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fb9bd7b6-f5db-4ea2-a952-c11ca65ba656 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.556479 Jan 14 09:46:32.457514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 104/203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:31 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:32.638252 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:32.640537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:32.663294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:32.699539 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.702367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:32.704255 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.713334 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:32.743899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e0fb64e0-9702-41b4-875b-65febff5d9f6 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.735177 Jan 14 09:46:32.748469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 100/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:32 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:32.808972 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:32.810575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:32.822511 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:32.824041 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.826014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:32.827285 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:32.838501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a0e12303-74e3-401c-8137-b7a715f54c80 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 27971 microversion: 2.1 time: 0.216835 Jan 14 09:46:32.839574 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 105/205] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:32 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 27971 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:46:32.973120 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-38c88678-98a1-4fe4-913a-f87b20f2566d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28464 microversion: 2.20 time: 0.169254 Jan 14 09:46:32.979512 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 101/206] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:32 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:33.466132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:33.469687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:33.475628 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:33.476163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:33.477397 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:33.477818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:33.699280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:33.717032 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c306e238-b28b-4a98-980f-07e522479fcf tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.254636 Jan 14 09:46:33.718501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 106/207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:33 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:33.772289 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:33.773688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:33.781670 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:33.782594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:33.783666 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:33.784323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:33.854814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:33.857264 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:33.872342 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:33.874764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:33.876249 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:33.878267 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:34.011684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-69a50819-6720-4453-aa66-74a5d9f53026 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28206 microversion: 2.1 time: 0.161938 Jan 14 09:46:34.013089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 107/208] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:33 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28206 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:34.026917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:34.030821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:34.046904 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:34.048146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:34.051622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:34.052133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:34.104530 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:34.130156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9380faca-4ba1-4bd3-ac02-8bce74e09b5b tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1314 microversion: 2.1 time: 0.363396 Jan 14 09:46:34.131159 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 102/209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:33 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:34.203984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ec25d86f-bc64-4ef7-86f6-356552993415 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28574 microversion: 2.20 time: 0.187627 Jan 14 09:46:34.209116 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 108/210] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:34 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:34.737751 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:34.738896 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:34.747304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:34.747962 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:34.748936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:34.749514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.015267 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:35.027489 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:35.029224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:35.036433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d9aa83fb-d503-4ff9-aef3-2df659863bc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.303721 Jan 14 09:46:35.038309 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 103/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:34 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:35.042711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.043577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.044617 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.045423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.132393 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-16ce9e49-b061-488f-96c4-2b471f1a25f5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28206 microversion: 2.1 time: 0.109787 Jan 14 09:46:35.133607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 109/212] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:35 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28206 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:35.150990 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:35.152446 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:35.165727 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.167143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.168871 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.170474 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.229185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:35.231783 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:35.246727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.248000 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.249836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.251460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.370888 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-eae38006-df0f-424b-a39f-69f337275872 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28632 microversion: 2.20 time: 0.155382 Jan 14 09:46:35.377894 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 110/213] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:35 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28632 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:35.431501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:35.453580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-de52808a-8e2b-4893-8e17-38ddb24c1734 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1464 microversion: 2.1 time: 0.308769 Jan 14 09:46:35.454946 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 104/214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:35 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1464 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:35.508275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:35.509190 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:35.518177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.518794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.519703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.520232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.604390 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:46:35.776708 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1423667737", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "3ec03e4c-b16e-4ceb-af1e-9c2edad3a01e"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:35.809682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d3e81acd-94c6-4e9a-aff3-90e28a154e50 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 204 len: 0 microversion: 2.1 time: 0.306028 Jan 14 09:46:35.813837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 111/215] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:46:35 2022] DELETE /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:46:35.820559 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:35.821359 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:35.828303 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.828749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.832790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:35.835322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:35.900127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] validate_networks() for [('3ec03e4c-b16e-4ceb-af1e-9c2edad3a01e', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:46:36.079391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:36.088644 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8e1721da-3703-4dd6-bf88-3f35560d616f tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1470 microversion: 2.1 time: 0.273364 Jan 14 09:46:36.101013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 112/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:35 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:36.105890 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:36.107615 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:36.116561 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.117026 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.117805 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.118638 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.413671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:36.425921 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-df606ebe-18f9-4eea-9ebf-1d2959fc1902 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.323182 Jan 14 09:46:36.427095 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 113/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:36 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:36.432967 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:36.434949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:36.450280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.450927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.451743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.452482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.550678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:46:36.551539 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:46:36.551539 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:46:36.551959 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:46:36.552552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:46:36.559100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bb33c02f-fa46-432d-807e-1d0c6779a598 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28497 microversion: 2.1 time: 0.126991 Jan 14 09:46:36.560074 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 114/218] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:36 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28497 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:36.567950 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:36.569342 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:36.576084 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.577082 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.579625 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.581058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.583571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.586998 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.589276 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:36.589809 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:36.617144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Getting quotas for project e8c5dc7c85e0401084a77fbddaa59ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:46:36.638974 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Getting quotas for user 4e44ed39b01c443e92fbbaeed5718fcc and project e8c5dc7c85e0401084a77fbddaa59ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:46:36.669002 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:46:36.677433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:46:36.692743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b583214b-99bf-4548-81e0-b0316ab7c2c9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28632 microversion: 2.20 time: 0.129266 Jan 14 09:46:36.694520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 115/219] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:36 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28632 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:36.793189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7e888b38-cc19-47f1-9a38-06c830c850f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024497 Jan 14 09:46:36.803463 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 105/220] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:46:36.813646 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bee35db8-08fa-42fc-9ed3-1eb394322a1d tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:36.815020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bee35db8-08fa-42fc-9ed3-1eb394322a1d tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:36.978516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bee35db8-08fa-42fc-9ed3-1eb394322a1d tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:36.993143 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bee35db8-08fa-42fc-9ed3-1eb394322a1d tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1214 microversion: 2.1 time: 0.187307 Jan 14 09:46:36.997099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 116/221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:36 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:37.117130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:37.118875 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:37.132019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.132019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.133452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.134239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.416580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:37.440941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d9ff3164-adfa-4552-878c-f3715a1d92ae tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1470 microversion: 2.1 time: 0.335932 Jan 14 09:46:37.443735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 106/222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:37 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:37.461541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:37.462619 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:37.475727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.477518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.478659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.479792 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.579158 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:37.582562 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:37.608722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.609888 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.612087 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.613204 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.683193 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:37.691665 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d71d5758-f4b4-4723-b81b-9ab2c6a9bcda tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1522 microversion: 2.1 time: 0.237924 Jan 14 09:46:37.692254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 117/223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:37 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:37.707027 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:37.707951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:37.715320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.715675 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.716477 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:37.716910 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:37.731790 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1f6c38ea-80ea-42ea-a6ef-8edee0462ce5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28665 microversion: 2.1 time: 0.162050 Jan 14 09:46:37.733522 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 107/224] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:37 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:37.836984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1f12a65b-f205-448e-8e71-7a4281462058 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28632 microversion: 2.20 time: 0.133739 Jan 14 09:46:37.837851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 118/225] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:37 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28632 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:38.031781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:38.036144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:38.056836 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.057701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.059739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.061213 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.194618 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:38.211449 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fe787416-0ac8-4156-af07-42b5964d6794 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1266 microversion: 2.1 time: 0.192368 Jan 14 09:46:38.213914 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 108/226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:38 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:38.465899 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:38.471295 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:38.478406 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-5d494ce0-c786-4dae-a778-1fc11790f9e3 req-74f48127-e758-435a-998f-60ac2009a839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b336a5-cb5b-4c67-a622-38e19ab3e072", "name": "network-vif-deleted", "tag": "3e490279-0871-49bf-b2a7-35bd468d9846"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:38.496927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:38.496927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:46:38.502656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.511997 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.512320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.514781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-5d494ce0-c786-4dae-a778-1fc11790f9e3 req-74f48127-e758-435a-998f-60ac2009a839 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.518980 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.529956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-5d494ce0-c786-4dae-a778-1fc11790f9e3 req-74f48127-e758-435a-998f-60ac2009a839 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.550433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-5d494ce0-c786-4dae-a778-1fc11790f9e3 req-74f48127-e758-435a-998f-60ac2009a839 service nova] Creating event network-vif-deleted:3e490279-0871-49bf-b2a7-35bd468d9846 for instance b5b336a5-cb5b-4c67-a622-38e19ab3e072 on hv-cinder-82160 Jan 14 09:46:38.565566 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-5d494ce0-c786-4dae-a778-1fc11790f9e3 req-74f48127-e758-435a-998f-60ac2009a839 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092564 Jan 14 09:46:38.566630 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 109/227] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:46:38.706812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4fd71f0fd54e16b8a9d7281985170f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e00a0e74f2414b9dd568f991ebe1a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:38.713030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:38.715067 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:38.725660 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a5e848d9-4f59-4594-b279-72d83bc06432 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 200 len: 1428 microversion: 2.1 time: 0.267359 Jan 14 09:46:38.728115 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 119/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:38 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 1428 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:38.732008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.734082 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.735595 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.738849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.744345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:38.745682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:38.759563 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.760126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.775824 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.777203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.885423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-451f4731-1d07-491b-a4c7-52d37dc9f412 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28665 microversion: 2.1 time: 0.144333 Jan 14 09:46:38.887153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 120/229] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:38 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:38.895712 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:38.912235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:38.923017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.929337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:38.930504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:38.931177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.083905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-058221b3-9257-4248-a7cf-499f8c0e4a2e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 28963 microversion: 2.20 time: 0.194670 Jan 14 09:46:39.087902 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 121/230] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:38 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 28963 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:39.224151 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:39.232308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:39.234307 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:39.239820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9ca1c6ed-058b-4cb7-b8b3-11dbd9a73c88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1502 microversion: 2.1 time: 0.533114 Jan 14 09:46:39.240866 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 110/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:38 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1502 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:39.248019 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.249649 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.252791 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.254980 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.276801 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:39.285194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:39.296588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.297034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.297998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.299070 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.380475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:39.399510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-db4981a9-2635-4898-bc43-ffa56fc2a1dd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1272 microversion: 2.1 time: 0.172092 Jan 14 09:46:39.401633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 122/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:39 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:39.754250 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:39.755594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] [instance: b5b336a5-cb5b-4c67-a622-38e19ab3e072] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:39.779888 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.780377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.781818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.783147 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.840996 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:39.845037 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] HTTP exception thrown: Instance b5b336a5-cb5b-4c67-a622-38e19ab3e072 could not be found. Jan 14 09:46:39.846830 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] Returning 404 to user: Instance b5b336a5-cb5b-4c67-a622-38e19ab3e072 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:46:39.848229 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f4b0bd74-fd08-48f1-b29f-77792c2bbcc9 tempest-VolumesNegativeTest-169600450 tempest-VolumesNegativeTest-169600450-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072" status: 404 len: 111 microversion: 2.1 time: 0.100739 Jan 14 09:46:39.849514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 123/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:39 2022] GET /compute/v2.1/servers/b5b336a5-cb5b-4c67-a622-38e19ab3e072 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:46:39.861990 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7660e08a-83d9-4adc-a956-a52f90dcb71c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1515 microversion: 2.1 time: 0.598072 Jan 14 09:46:39.862614 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 111/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:39 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1515 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:39.901633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:39.903261 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:39.940837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.946301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:39.949031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:39.949928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:40.085841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-486d3f4b-ae97-4f86-ac5b-2e6dd20b7f9d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28665 microversion: 2.1 time: 0.190857 Jan 14 09:46:40.101772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:40.107544 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 124/235] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:39 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28665 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:40.108008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:40.124875 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:40.125674 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:40.126764 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:40.127488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:40.222772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3ae76495-d39d-4535-bd14-e36e87e83d70 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 30372 microversion: 2.20 time: 0.130949 Jan 14 09:46:40.224247 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 112/236] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:40 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 30372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:40.423940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:40.430791 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:40.462722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:40.463561 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:40.464983 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:40.465797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:40.796460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:40.821303 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-565854a3-5c3b-41c3-9d2f-302ff0ea3d5e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.403146 Jan 14 09:46:40.823385 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 125/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:40 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:41.129992 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:41.134514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:41.163271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.166413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.170969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.176492 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.241780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:41.247483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:41.276151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.276464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5411cd92-1b8d-4774-bf6f-ad5908561b93 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 28665 microversion: 2.1 time: 0.160577 Jan 14 09:46:41.276934 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.278881 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 113/238] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:41 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 28665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:41.283928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.290163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.337014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-72a275cc-ba50-4e7a-9ff7-ec2d8210abcc req-c9674b83-3325-470b-8118-4213be04124a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc41f886-a258-4d06-94d7-82fe40ab9a3c", "tag": "a71be28b-6728-45d2-8acb-a6d3f5284383"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:41.339400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:41.339400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:46:41.361281 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-72a275cc-ba50-4e7a-9ff7-ec2d8210abcc req-c9674b83-3325-470b-8118-4213be04124a service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.363268 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-72a275cc-ba50-4e7a-9ff7-ec2d8210abcc req-c9674b83-3325-470b-8118-4213be04124a service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.399470 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-72a275cc-ba50-4e7a-9ff7-ec2d8210abcc req-c9674b83-3325-470b-8118-4213be04124a service nova] Creating event network-changed:a71be28b-6728-45d2-8acb-a6d3f5284383 for instance dc41f886-a258-4d06-94d7-82fe40ab9a3c on hv-cinder-82160 Jan 14 09:46:41.416425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-72a275cc-ba50-4e7a-9ff7-ec2d8210abcc req-c9674b83-3325-470b-8118-4213be04124a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083746 Jan 14 09:46:41.418912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 114/239] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:46:41.518640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b1a44796-f265-4fe5-af42-633f10f59342 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 32055 microversion: 2.20 time: 0.285123 Jan 14 09:46:41.520215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 126/240] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:41 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 32055 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:41.702462 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:41.705308 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:41.712367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.713245 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.714279 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.715016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.757098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lazy-loading 'flavor' on Instance uuid 468932bd-d6e7-43a5-84f1-53cc479aa7b0 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:46:41.844271 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:41.846006 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:41.860090 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.865576 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.869349 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.870272 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.949547 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-33aeedb6-803f-4edb-902e-b5e95bd83c05 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action" status: 200 len: 32 microversion: 2.1 time: 0.252028 Jan 14 09:46:41.955099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 115/241] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:41 2022] POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 14 09:46:41.961105 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:41.962108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:41.970786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.971590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:41.972417 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:41.972862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:42.080196 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:42.088577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b3a1e9f3-a73c-400b-b09f-c0ef6454464a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.249309 Jan 14 09:46:42.089511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 127/242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:41 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:42.206531 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:42.215805 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-38451bd3-0583-43b9-8df2-f81d0b3e44c0 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.258784 Jan 14 09:46:42.230120 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 116/243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:41 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:42.291257 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:42.292870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:42.301460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:42.302166 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:42.303591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:42.312388 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:42.535863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:42.537636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:42.549265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:42.550371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:42.551772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:42.554175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:44.395428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-eacf17e7-4a08-499d-90b2-8892510a65b9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 31688 microversion: 2.1 time: 2.108387 Jan 14 09:46:44.396459 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 128/244] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:42 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 31688 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:46:44.404780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:44.406185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:44.418663 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:44.419385 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:44.420440 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:44.420992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:44.425264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-63b51e56-b48d-469b-bbd6-efd2edec4aed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 34382 microversion: 2.20 time: 1.893708 Jan 14 09:46:44.427113 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 117/245] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:42 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 34382 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:44.437540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:44.441079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:44.455409 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:44.456977 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:44.459131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:44.462688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:44.678315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:44.692944 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-517a4450-da22-4c3b-800a-994d47af4a41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.294732 Jan 14 09:46:44.695683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 129/246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:44 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:44.965711 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:44.975284 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7b06fe66-b9ac-4687-9215-b3359c1586f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.545732 Jan 14 09:46:44.975913 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 118/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:44 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:45.414956 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:45.416946 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:45.430343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:45.431817 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:45.433669 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:45.434872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:45.446093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:45.448509 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:45.477225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:45.478596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:45.480506 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:45.483081 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:45.600635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-41e1ef9e-de94-4322-924a-155a47390031 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 32332 microversion: 2.1 time: 0.192460 Jan 14 09:46:45.609543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 130/248] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:45 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 32332 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:45.626853 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ae8a2a81-5198-45eb-9b0e-fa8d8df3f3ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 35086 microversion: 2.20 time: 0.185313 Jan 14 09:46:45.628084 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 119/249] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:45 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 35086 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:46:45.715197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:45.716170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:45.727961 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:45.729386 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:45.730233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:45.731080 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:45.922322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:45.932368 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-60570e67-b7cb-46e9-b0a2-a4d88098a792 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.222955 Jan 14 09:46:45.933401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 131/250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:45 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:45.998217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:45.999731 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:46.046216 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.048934 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.051914 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.052660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.280588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:46.291134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0bc053f0-ac83-4a8c-819e-1ae698b9c540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.300379 Jan 14 09:46:46.291777 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 120/251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:45 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:46.616339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:46.617367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:46.624254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.624691 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.625683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.626821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.642516 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:46.644115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:46.658229 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.658735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.659570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.660160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.740459 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a7d7dc43-a384-408f-9b95-5bebd8ea948b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 33071 microversion: 2.1 time: 0.127300 Jan 14 09:46:46.749225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 132/252] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:46 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 33071 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:46.765601 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-84d5f472-b7f5-44d3-95db-791513ecea5a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 36117 microversion: 2.20 time: 0.127177 Jan 14 09:46:46.766573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 121/253] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:46 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 36117 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:46:46.958968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:46.960309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:46.978639 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.979396 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:46.980795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:46.981587 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.177964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:47.189561 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e64d4d8c-1fc3-4457-9323-136ab9f907fc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.235287 Jan 14 09:46:47.190156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 133/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:46 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:47.315060 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:47.316697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:47.336797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:47.338494 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.342598 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:47.345038 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.660870 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:47.669380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8c252483-e109-4f8d-bc5e-c933704d1540 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.364286 Jan 14 09:46:47.682232 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 122/255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:47 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:47.756206 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:47.757972 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:47.772483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:47.780370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:47.781339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:47.783991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.785119 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:47.785769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.794564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:47.795996 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.797571 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:47.799293 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:47.884459 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fb872093-4b73-4d56-a347-3dc37fc38c12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 33866 microversion: 2.1 time: 0.131303 Jan 14 09:46:47.891681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 134/256] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:47 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 33866 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:47.900948 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0ae1c16f-0f9d-4da3-827a-8736c8cfc2aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 37274 microversion: 2.20 time: 0.125553 Jan 14 09:46:47.903280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 123/257] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:47 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 37274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:48.211388 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:48.213437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:48.232613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:48.236194 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:48.237833 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:48.239649 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:48.690745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:48.691458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:48.713927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:48.719711 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:48.721566 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:48.722029 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:48.737367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:48.749126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-91561bd9-2933-47ec-b1c2-c8f5f4d182f5 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.543638 Jan 14 09:46:48.749906 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 135/258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:48 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:48.919907 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:48.920978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:48.948452 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:48.954416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:48.960571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:48.964497 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:49.092537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4fab4ee4-8f8b-4471-8315-cfd0d7b4d770 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 35037 microversion: 2.1 time: 0.189626 Jan 14 09:46:49.093208 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 136/259] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:48 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 35037 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:49.099093 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:49.100137 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:49.108184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:49.108777 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:49.109444 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:49.109889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:49.232285 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0c760eb6-bf51-4935-8084-80c321cece73 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 38171 microversion: 2.20 time: 0.137120 Jan 14 09:46:49.239550 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 137/260] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:49 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 38171 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:49.387738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:49.397268 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4dcff68d-e667-49e8-b39b-56f085694bae tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.711916 Jan 14 09:46:49.399016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 124/261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:48 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:49.616411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-38d8d345-fa34-4c4d-96cb-022898ffe91e req-b88b4124-4a26-4476-8465-677e2ff9dae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc41f886-a258-4d06-94d7-82fe40ab9a3c", "name": "network-vif-plugged", "status": "completed", "tag": "a71be28b-6728-45d2-8acb-a6d3f5284383"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:49.618394 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:49.618394 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:46:49.633025 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-38d8d345-fa34-4c4d-96cb-022898ffe91e req-b88b4124-4a26-4476-8465-677e2ff9dae2 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:49.634265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-38d8d345-fa34-4c4d-96cb-022898ffe91e req-b88b4124-4a26-4476-8465-677e2ff9dae2 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:49.657936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-38d8d345-fa34-4c4d-96cb-022898ffe91e req-b88b4124-4a26-4476-8465-677e2ff9dae2 service nova] Creating event network-vif-plugged:a71be28b-6728-45d2-8acb-a6d3f5284383 for instance dc41f886-a258-4d06-94d7-82fe40ab9a3c on hv-cinder-82160 Jan 14 09:46:49.668701 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-38d8d345-fa34-4c4d-96cb-022898ffe91e req-b88b4124-4a26-4476-8465-677e2ff9dae2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057472 Jan 14 09:46:49.669836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 138/262] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:49.777043 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:49.777783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:49.792808 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:49.798699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:49.802154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:49.803733 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.058165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:50.066672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4a7f61ec-6857-4f58-8de8-d9b23270f32b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.294336 Jan 14 09:46:50.067768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 125/263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:49 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:50.110317 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:50.112052 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:50.121183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:50.122176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.123632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:50.124382 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.250454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:50.252817 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:50.262657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:50.263447 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.264733 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:50.266292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.322704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-88297218-9df9-45f1-ade7-f4d665fe41cb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 36058 microversion: 2.1 time: 0.217609 Jan 14 09:46:50.325181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 139/264] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:50 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 36058 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:50.396134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8847a6c3-fe85-401d-8dec-945d0ccc5939 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 38171 microversion: 2.20 time: 0.150409 Jan 14 09:46:50.398287 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 126/265] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:50 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 38171 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:46:50.427038 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:50.427876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:50.439819 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:50.440684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.442215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:50.443214 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:50.621957 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:50.636591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-81c536cb-7702-4129-9520-f612d371b13a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.213941 Jan 14 09:46:50.650868 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 140/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:50 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:51.091717 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:51.092438 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:51.100304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.100704 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.101815 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.102535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.284688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:51.298591 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a44d434d-842b-46bd-b799-46c7a4b4adf9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1314 microversion: 2.1 time: 0.210354 Jan 14 09:46:51.308014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 127/267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:51 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:51.338243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:51.339952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:51.351212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.352289 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.353153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.353630 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.413620 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:51.415665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:51.424856 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.426583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.428260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.428820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.446165 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a56bedd6-01d4-4da0-beda-23777b80b252 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 36944 microversion: 2.1 time: 0.112218 Jan 14 09:46:51.449419 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 141/268] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:51 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 36944 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:51.529737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ca863691-e7ec-4129-863e-87631bfb6ad0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 200 len: 38311 microversion: 2.20 time: 0.122894 Jan 14 09:46:51.530426 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 128/269] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:51 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 38311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:46:51.546324 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:51.547719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:51.559805 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.561264 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.563202 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.564348 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.617741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c66c13e8-abfe-4640-9bfb-85d5746c7a89 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/ips" status: 200 len: 151 microversion: 2.20 time: 0.077475 Jan 14 09:46:51.619030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 142/270] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jan 14 09:46:51 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/ips => generated 151 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:51.662150 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:51.663057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:51.672171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.673711 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.674794 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:51.675439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:51.917602 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:51.928626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6c28da23-28f2-4e99-8cda-b8990657c557 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.270948 Jan 14 09:46:51.929780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 129/271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:51 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:52.103155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1235757819", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "4455b2ae-129a-4b69-bef7-804a2060c5d4"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:52.215206 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] validate_networks() for [('4455b2ae-129a-4b69-bef7-804a2060c5d4', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:46:52.321014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:52.322194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:52.332088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.332782 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.348118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.348118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.607190 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:52.656195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-edc32f1e-f64c-413b-a014-7cddcf4df7c8 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1497 microversion: 2.1 time: 0.340335 Jan 14 09:46:52.657874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 130/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:52 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:52.668101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:52.683310 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:52.730257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.737745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.739325 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.740180 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.824865 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:46:52.825729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:46:52.826759 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:46:52.827644 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:46:52.828748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:46:52.848877 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.849488 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.851333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.852167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.856136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-53085632-dc5b-4d99-8b90-74cb49e71e99 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 38190 microversion: 2.1 time: 0.196190 Jan 14 09:46:52.859162 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 131/273] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:52 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 38190 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:52.895598 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Getting quotas for project 36d4eb96fed0490a9a5263574e28cb3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:46:52.907233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Getting quotas for user 0dccf92db9cd4931837ed36683feab70 and project 36d4eb96fed0490a9a5263574e28cb3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:46:52.928795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:46:52.933534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:46:52.956400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:52.957175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:52.977151 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.977607 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:52.978445 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:52.978886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.041818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ea7e1eab-c64d-4b89-84f9-790aa122703f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944907 Jan 14 09:46:53.043674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 143/274] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:46:53.063930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-93015f0e-700c-4ff3-b33f-5f38f8ab95c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:53.065968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-93015f0e-700c-4ff3-b33f-5f38f8ab95c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:53.204180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93015f0e-700c-4ff3-b33f-5f38f8ab95c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:53.229376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-93015f0e-700c-4ff3-b33f-5f38f8ab95c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1219 microversion: 2.1 time: 0.178271 Jan 14 09:46:53.232919 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 144/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:53 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:53.289279 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:53.308136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a1a0a5b7-766b-4135-839d-99570a91624e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.355845 Jan 14 09:46:53.310257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 132/276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:52 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:53.442870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:53.443749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:53.461368 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:53.461981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.463247 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:53.464021 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.505509 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:46:53.630532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7ff3cef6-b0da-4b25-b593-cce36ebace87 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 204 len: 0 microversion: 2.1 time: 0.192048 Jan 14 09:46:53.636056 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 145/277] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:46:53 2022] DELETE /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:46:53.641719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:53.642640 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:53.659085 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:53.659523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.660339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:53.660928 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.872082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:53.873499 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:53.882209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:53.891511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:53.893789 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ce78dae7-8868-4ae4-a6f2-fc983260477e tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1503 microversion: 2.1 time: 0.252909 Jan 14 09:46:53.894470 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 133/278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:53 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:53.897952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.899092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:53.899722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:53.982496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2511fa12-5042-4885-bb1a-c897854895a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 38190 microversion: 2.1 time: 0.114196 Jan 14 09:46:53.983921 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 146/279] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:53 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 38190 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:54.087916 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:54.088458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:54.095720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.096454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.097837 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.098887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.154543 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lazy-loading 'flavor' on Instance uuid a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:46:54.258616 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:54.259321 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:54.266868 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.267563 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.268589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.269243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.361617 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:54.386061 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d91d65dd-a052-4881-b570-e5b13ae15a4e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1271 microversion: 2.1 time: 0.130785 Jan 14 09:46:54.394637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 147/280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:54 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:54.413694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:54.418818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:54.431711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.432925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.434781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.436348 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.575598 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1fb76468-e4c5-441b-a32b-0ccec971e076 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 202 len: 0 microversion: 2.20 time: 0.490901 Jan 14 09:46:54.576688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 134/281] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:46:54 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:46:54.599307 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:54.603334 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:54.623513 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.623906 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.624839 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.625689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.841086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:54.855637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3ed07556-04cd-48a9-aaf2-a0388c4785c8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.456715 Jan 14 09:46:54.857156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 148/282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:54 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:54.914497 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:54.915554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:54.924978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.925434 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:54.926272 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:54.926739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.129292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:55.131331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:55.139346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:55.140026 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cf39478a-bc4d-4ca9-99b9-85c5da5ffa3b tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1503 microversion: 2.1 time: 0.232543 Jan 14 09:46:55.140613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 149/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:54 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:46:55.142266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:55.143754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-35b4b05b-2c17-447a-82f7-cd64365f3d35 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.560745 Jan 14 09:46:55.145571 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 135/284] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:46:54 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:46:55.146267 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:55.147362 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:55.171370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.176374 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.177827 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.179051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.325132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f34f5488-b685-4cc5-98f8-8db2cf88a5bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 200 len: 38321 microversion: 2.1 time: 0.181906 Jan 14 09:46:55.331868 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 150/285] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:46:55 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 38321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:46:55.341486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:55.342087 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:55.351825 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.352380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.354433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.354866 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.391852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-09b57e4d-580e-4766-b5d3-8d0dda886c77 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/ips" status: 200 len: 145 microversion: 2.1 time: 0.057853 Jan 14 09:46:55.392811 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 136/286] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jan 14 09:46:55 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/ips => generated 145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:55.417203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:55.417916 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:55.430297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.430878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.432039 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.432560 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.508258 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:55.523802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2e27a2d2-a5c1-4143-942b-8027e72128ec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1277 microversion: 2.1 time: 0.110661 Jan 14 09:46:55.532048 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 151/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:55 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:55.874096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:55.874685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:55.885735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.885735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:55.885735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:55.886083 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.172120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:56.177269 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:56.194533 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.196043 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.198049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.200075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.339286 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:56.370687 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5b644ca3-a0b6-4b9b-80d6-da565aad4d6f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.490949 Jan 14 09:46:56.376686 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 137/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:55 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:56.398044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:56.399266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:56.427569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.428814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.433578 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.434302 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.540309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:56.552722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ed78e507-912a-45b8-a6d5-bcd1a5daf284 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 200 len: 1503 microversion: 2.1 time: 0.392864 Jan 14 09:46:56.553972 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 152/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:56 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:56.560159 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:56.561226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:56.568105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.568986 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.570327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.571510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.784713 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:56.801007 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-04441e31-a45a-4ad1-8da2-4559160810c5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.244958 Jan 14 09:46:56.827470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 153/290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:56 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:56.842524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-314bd223-d8a8-45c5-9391-8849263b643a req-b0db923c-5431-47f2-adac-1fe5fae9ddab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc41f886-a258-4d06-94d7-82fe40ab9a3c", "name": "network-vif-deleted", "tag": "a71be28b-6728-45d2-8acb-a6d3f5284383"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:56.852384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:56.852384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:46:56.864410 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-314bd223-d8a8-45c5-9391-8849263b643a req-b0db923c-5431-47f2-adac-1fe5fae9ddab service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:56.865376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-314bd223-d8a8-45c5-9391-8849263b643a req-b0db923c-5431-47f2-adac-1fe5fae9ddab service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:56.883428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-314bd223-d8a8-45c5-9391-8849263b643a req-b0db923c-5431-47f2-adac-1fe5fae9ddab service nova] Creating event network-vif-deleted:a71be28b-6728-45d2-8acb-a6d3f5284383 for instance dc41f886-a258-4d06-94d7-82fe40ab9a3c on hv-cinder-82160 Jan 14 09:46:56.889562 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:56.894340 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-314bd223-d8a8-45c5-9391-8849263b643a req-b0db923c-5431-47f2-adac-1fe5fae9ddab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064445 Jan 14 09:46:56.895672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 154/291] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:56.902780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:56.906384 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:56.909579 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0e7ed2b0-07e8-455d-a407-ef4986392442 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.529463 Jan 14 09:46:56.910541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 138/292] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:46:56 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:46:57.397189 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:57.397901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:57.405554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:57.406199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:57.407421 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:57.407864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:57.557784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:57.570320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7cf5c573-90f2-402d-bfbb-bdefcaa7c51c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.177062 Jan 14 09:46:57.571081 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:57.571689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: dc41f886-a258-4d06-94d7-82fe40ab9a3c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:57.571947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 155/293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:57 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:57.581017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:57.581397 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:57.582182 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:57.582641 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:57.605766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] HTTP exception thrown: Instance dc41f886-a258-4d06-94d7-82fe40ab9a3c could not be found. Jan 14 09:46:57.607006 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Returning 404 to user: Instance dc41f886-a258-4d06-94d7-82fe40ab9a3c could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:46:57.611063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dbc58b2e-0c28-477e-8494-c511cc5263c3 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c" status: 404 len: 111 microversion: 2.1 time: 0.042456 Jan 14 09:46:57.612472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 139/294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:57 2022] GET /compute/v2.1/servers/dc41f886-a258-4d06-94d7-82fe40ab9a3c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:46:57.709773 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a4a65f6-0fa0-4298-a787-93a97fa14a5f"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:57.715025 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:57.726130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:57.727050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:57.728170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:57.728810 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:57.803782 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1946099507", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "3ec03e4c-b16e-4ceb-af1e-9c2edad3a01e"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:57.935581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] validate_networks() for [('3ec03e4c-b16e-4ceb-af1e-9c2edad3a01e', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:46:58.113621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2f07634b-6009-4b8d-bd80-537238e0370d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407333 Jan 14 09:46:58.116119 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 156/295] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:46:57 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:58.121887 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:58.122728 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:58.134407 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.135017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.136073 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.136657 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.330202 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:58.343199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9f16d444-a58b-415f-b273-bf7fd2b57f29 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.225479 Jan 14 09:46:58.344158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 157/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:58 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:58.350317 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:58.351319 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:58.358581 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.359234 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.360209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.360821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.539351 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:46:58.540111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:46:58.540580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:46:58.541259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:46:58.541854 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:46:58.546089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:58.557183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.558526 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.560040 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.561176 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.570107 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:58.572909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:58.577960 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-618cfe06-2fa1-4aa1-893a-8466c4e0052f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.231213 Jan 14 09:46:58.581056 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 158/297] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:46:58 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:46:58.591649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Getting quotas for project e8c5dc7c85e0401084a77fbddaa59ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:46:58.596559 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:58.597598 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:58.597955 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Getting quotas for user 4e44ed39b01c443e92fbbaeed5718fcc and project e8c5dc7c85e0401084a77fbddaa59ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:46:58.608704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.609519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.611667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.612571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.614157 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:46:58.616845 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:46:58.686074 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-40ecb822-fbaf-4a8f-ad96-2bfbbbce64f9 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885629 Jan 14 09:46:58.692849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 140/298] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 14 09:46:58.705849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ac79ebd0-cd2a-40a3-947c-4a420bba9197 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:58.706680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ac79ebd0-cd2a-40a3-947c-4a420bba9197 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:58.799150 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ac79ebd0-cd2a-40a3-947c-4a420bba9197 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:58.807883 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ac79ebd0-cd2a-40a3-947c-4a420bba9197 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1214 microversion: 2.1 time: 0.107363 Jan 14 09:46:58.815417 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 141/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:58 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:58.836113 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:58.843899 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f5617e0f-39c3-4560-9631-f1a3f3465b4e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.259330 Jan 14 09:46:58.845212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 159/300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:58 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:58.911994 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-d1ba5d0c-9e12-4e3c-86f6-687a99579f91 req-0de50c08-ed68-492b-9280-e162e949397d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b470a71-5d32-4dc8-895f-4a0e54d002d5", "tag": "069c8609-2930-41ad-9021-3efaee2425f5"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:46:58.913783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:46:58.913783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:46:58.922631 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-d1ba5d0c-9e12-4e3c-86f6-687a99579f91 req-0de50c08-ed68-492b-9280-e162e949397d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:58.923337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-d1ba5d0c-9e12-4e3c-86f6-687a99579f91 req-0de50c08-ed68-492b-9280-e162e949397d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:58.934428 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-d1ba5d0c-9e12-4e3c-86f6-687a99579f91 req-0de50c08-ed68-492b-9280-e162e949397d service nova] Creating event network-changed:069c8609-2930-41ad-9021-3efaee2425f5 for instance 7b470a71-5d32-4dc8-895f-4a0e54d002d5 on hv-cinder-82160 Jan 14 09:46:58.940364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-d1ba5d0c-9e12-4e3c-86f6-687a99579f91 req-0de50c08-ed68-492b-9280-e162e949397d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Jan 14 09:46:58.941101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 142/301] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:46:59.366442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:59.367396 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:59.376441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:59.376898 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:59.377755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:59.378193 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:59.603860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:59.615410 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:59.616885 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-08166dc6-bb43-4ddc-954d-8242379a4301 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.257071 Jan 14 09:46:59.618075 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:59.618262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 160/302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:59 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:59.636516 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:59.637818 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:59.639563 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:59.640491 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:59.830221 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:59.830957 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:46:59.838059 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:59.838552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:59.839358 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:46:59.839812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:46:59.962762 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:59.981349 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-23e52f72-30ab-4e2a-b376-4684296416af tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1274 microversion: 2.1 time: 0.157773 Jan 14 09:46:59.983096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 161/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:59 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:46:59.991419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:46:59.993266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:46:59.994477 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:00.011672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:00.013886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:00.014879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:00.015955 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:00.016527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:00.018327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:00.019713 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-771b4817-c3b7-4054-a040-15c01d9aa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.423199 Jan 14 09:47:00.020299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 143/304] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:46:59 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:00.212138 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:00.224577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2fa00325-1c33-4220-af63-46b6018b8362 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.238128 Jan 14 09:47:00.225807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 162/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:46:59 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:00.643058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:00.643821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:00.657620 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:00.657941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:00.658776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:00.659551 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:00.918325 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:00.932202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-68f312d0-f01f-4e04-bb10-fff6627580dc tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.292169 Jan 14 09:47:00.934390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 144/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:00 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:01.003765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:01.005092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:01.013327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.013825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.014729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.015183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.048748 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:01.049658 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:01.057871 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.058860 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.060448 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.061413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.183099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:01.193659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3d0b0981-0e26-4298-a351-c6c20c276679 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.195963 Jan 14 09:47:01.194778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 163/307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:00 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:01.251392 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:01.253466 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:01.267526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.268355 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.269764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.270700 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.502191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:01.510687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d9d4e022-bf56-4e11-9485-e031fe036354 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.263898 Jan 14 09:47:01.511749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 164/308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:01 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:01.656266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:01.669831 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:01.671984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:01.674007 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fef0a454-7ab7-46ee-bce5-6c02508cfe7f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.629869 Jan 14 09:47:01.675102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 145/309] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:01 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:01.851075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-f248d73d-f958-4ee7-84d6-56ff82b92817 req-a317508f-9cb5-49e4-948b-d1e2de9a8cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad", "tag": "9dd5161b-0034-474f-bd61-d5ee9713786e"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:01.853411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:47:01.853411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:47:01.871470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-f248d73d-f958-4ee7-84d6-56ff82b92817 req-a317508f-9cb5-49e4-948b-d1e2de9a8cb8 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.872186 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-f248d73d-f958-4ee7-84d6-56ff82b92817 req-a317508f-9cb5-49e4-948b-d1e2de9a8cb8 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.883915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-f248d73d-f958-4ee7-84d6-56ff82b92817 req-a317508f-9cb5-49e4-948b-d1e2de9a8cb8 service nova] Creating event network-changed:9dd5161b-0034-474f-bd61-d5ee9713786e for instance 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad on hv-cinder-82160 Jan 14 09:47:01.889210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-f248d73d-f958-4ee7-84d6-56ff82b92817 req-a317508f-9cb5-49e4-948b-d1e2de9a8cb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044802 Jan 14 09:47:01.890429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 165/310] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:47:01.958826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:01.959884 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:01.973636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.975223 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:01.976674 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:01.977112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.219960 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:02.221271 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:02.233927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:02.234580 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.236083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:02.236625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.335430 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:02.371045 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-845cfe46-6c60-4e7c-95a2-b95871385c2b tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.419678 Jan 14 09:47:02.372321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 146/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:01 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:02.486705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:02.500756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ef0840b9-03bc-4a49-b68c-97a9f89a7374 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.289947 Jan 14 09:47:02.519261 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 166/312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:02 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:02.533355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:02.534523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:02.543546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:02.544008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.545022 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:02.545461 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.694093 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:02.695222 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:02.702091 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:02.703054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.704877 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:02.705548 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:02.962936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:02.963353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:02.974321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-afa22086-779a-4d5d-b1ec-51d580140255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.448721 Jan 14 09:47:02.975818 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 147/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:02 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:02.982067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:02.985068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:02.987642 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-970b09fe-0904-4f46-b9fb-513da9f48d45 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.298345 Jan 14 09:47:02.988676 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 167/314] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:02 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:03.397464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:03.398598 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:03.416128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:03.416862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:03.417931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:03.418709 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:03.526749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:03.528467 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:03.537495 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:03.538475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:03.539656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:03.540302 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:03.763777 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:03.771922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:03.772287 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8f571c6c-3123-40e5-8f17-a6b58a1e86bf tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.378797 Jan 14 09:47:03.773723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 148/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:03 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:03.779088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-4609a062-0e55-49e1-9a16-2b7863abbeef req-da795c8f-da49-4369-ba51-6ffde3e7f85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b470a71-5d32-4dc8-895f-4a0e54d002d5", "name": "network-vif-plugged", "status": "completed", "tag": "069c8609-2930-41ad-9021-3efaee2425f5"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:03.781108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:47:03.781108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:47:03.788722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-87b6aba7-1461-49a6-9881-9a4c2587b641 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.265916 Jan 14 09:47:03.789847 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-4609a062-0e55-49e1-9a16-2b7863abbeef req-da795c8f-da49-4369-ba51-6ffde3e7f85e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:03.790305 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-4609a062-0e55-49e1-9a16-2b7863abbeef req-da795c8f-da49-4369-ba51-6ffde3e7f85e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:03.790694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 168/316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:03 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:03.809505 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-4609a062-0e55-49e1-9a16-2b7863abbeef req-da795c8f-da49-4369-ba51-6ffde3e7f85e service nova] Creating event network-vif-plugged:069c8609-2930-41ad-9021-3efaee2425f5 for instance 7b470a71-5d32-4dc8-895f-4a0e54d002d5 on hv-cinder-82160 Jan 14 09:47:03.815262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-4609a062-0e55-49e1-9a16-2b7863abbeef req-da795c8f-da49-4369-ba51-6ffde3e7f85e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040661 Jan 14 09:47:03.815861 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 149/317] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:47:03.992744 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:03.993537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:04.000844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.000844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.001631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.002083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.016419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:04.017175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:04.029961 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.031001 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.033088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.034394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.267950 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:04.279896 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-55bf6734-9b7d-4f50-b993-0ff6142cf06d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.291083 Jan 14 09:47:04.280617 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 169/318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:03 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:04.293521 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:04.306706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:04.308748 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:04.310270 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a433c5aa-9b29-48f3-bfca-8362cade2f5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.307064 Jan 14 09:47:04.311178 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 150/319] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:04 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:04.790780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:04.791470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:04.807561 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:04.808609 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:04.809863 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.810502 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.812315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.814978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.816725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.817183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.818429 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:04.821659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:04.989734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:04.998589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-11352ccf-3c2e-4daa-b423-44f4835b3b85 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1319 microversion: 2.1 time: 0.211434 Jan 14 09:47:04.999205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 170/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:04 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:05.010131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:05.018122 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9f512149-e109-45c3-8523-ff253f9aaa23 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.214552 Jan 14 09:47:05.027421 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 151/321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:04 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:05.303198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:05.307717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:05.328510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.330082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.331529 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.332333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.336243 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:05.337510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:05.348955 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.350611 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.351810 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.352528 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.659805 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:05.674707 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:05.686320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:05.689504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0373dba5-43f0-4483-92b3-ad4f54373d2b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1501 microversion: 2.1 time: 0.395154 Jan 14 09:47:05.694737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:05.695954 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a25ccc38-b7bc-49e9-9f15-ad3039eb9ffb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.368541 Jan 14 09:47:05.696506 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 152/323] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:05 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:05.696685 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 171/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:05 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:05.717214 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dcec268-9c41-4f58-b93e-e2c04abce2cf"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:05.719868 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:05.729890 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.730367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.731175 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.732201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.761086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] HTTP exception thrown: Cannot 'attach_volume' instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 while it is in vm_state rescued Jan 14 09:47:05.761726 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Returning 409 to user: Cannot 'attach_volume' instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 while it is in vm_state rescued {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:47:05.762653 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-de28eb0f-c161-4f09-ba11-e3c0be9cdea3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050802 Jan 14 09:47:05.763223 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 172/324] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:47:05 2022] POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 14 09:47:05.773893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:05.774456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:05.780846 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.782342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.782836 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.783272 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.865398 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c346e399-b916-42bd-935b-e2b9abae52b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.095262 Jan 14 09:47:05.866252 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 153/325] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:47:05 2022] POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:47:05.874518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:05.875169 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:05.882371 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.882866 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:05.883684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:05.884129 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.027684 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:06.030601 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:06.041021 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.041517 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.043540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.044608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.088472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:06.108873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-421516f1-d75b-43ce-a892-a6c199fcd235 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1509 microversion: 2.1 time: 0.237706 Jan 14 09:47:06.112534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 173/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:05 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:06.126153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:06.127183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:06.152465 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.153593 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.155153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.155990 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.347629 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:06.380275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3574f0b1-d0b6-4c10-afab-db89a28b7c43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1508 microversion: 2.1 time: 0.361645 Jan 14 09:47:06.382928 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 154/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:06 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:06.411290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b96bd909-1442-496a-a419-0cba97c067bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:06.432675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b96bd909-1442-496a-a419-0cba97c067bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.433135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b96bd909-1442-496a-a419-0cba97c067bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.436119 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:06.463863 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7ecd6e46-05d7-47e7-92c5-fa3de2b1187f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.350162 Jan 14 09:47:06.478310 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 174/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:06 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:06.543953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b96bd909-1442-496a-a419-0cba97c067bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Going to try to stop instance {{(pid=128092) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 14 09:47:06.604796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b96bd909-1442-496a-a419-0cba97c067bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.208872 Jan 14 09:47:06.607157 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 155/329] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:47:06 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:47:06.615137 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:06.616069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:06.624070 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.624534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.626754 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.627228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.731661 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:06.733126 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:06.748951 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.749596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.750749 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:06.751320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:06.839045 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:06.855015 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a37320c5-0349-435a-ad4c-5cfaec24a953 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.243374 Jan 14 09:47:06.856021 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 175/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:06 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:07.004999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:07.014583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:07.016728 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:07.018057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-39ab13c2-2fcd-4732-84b7-2fc9c926ee90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.299356 Jan 14 09:47:07.018834 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 156/331] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:06 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:07.138585 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:07.139380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:07.148074 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.148599 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:07.149412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.149853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:07.309118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:07.321795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-72662ffc-c941-4690-9bcf-c34b97942094 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1509 microversion: 2.1 time: 0.188780 Jan 14 09:47:07.322402 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 176/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:07 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:07.487085 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:07.488587 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:07.512876 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.513669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:07.515446 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.516483 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:07.662659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-8107eda0-295f-4b6b-a7c3-b9ec29837691 req-482eb8ad-ec19-48b4-8786-0c7a322bb271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad", "name": "network-vif-plugged", "status": "completed", "tag": "9dd5161b-0034-474f-bd61-d5ee9713786e"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:07.664462 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:47:07.664462 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:47:07.673640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-8107eda0-295f-4b6b-a7c3-b9ec29837691 req-482eb8ad-ec19-48b4-8786-0c7a322bb271 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.674331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-8107eda0-295f-4b6b-a7c3-b9ec29837691 req-482eb8ad-ec19-48b4-8786-0c7a322bb271 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:07.698155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-8107eda0-295f-4b6b-a7c3-b9ec29837691 req-482eb8ad-ec19-48b4-8786-0c7a322bb271 service nova] Creating event network-vif-plugged:9dd5161b-0034-474f-bd61-d5ee9713786e for instance 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad on hv-cinder-82160 Jan 14 09:47:07.704127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-8107eda0-295f-4b6b-a7c3-b9ec29837691 req-482eb8ad-ec19-48b4-8786-0c7a322bb271 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044936 Jan 14 09:47:07.707811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 177/333] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:47:07.757479 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:07.765627 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d9db399e-27d0-4564-b3af-6c7c4e949ebd tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.287752 Jan 14 09:47:07.766224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 157/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:07 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:07.874380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:07.875655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:07.882199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.882705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:07.883508 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:07.883952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.043230 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:08.044319 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:08.054036 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:08.054784 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.055887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:08.056852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.071876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:08.080576 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4be20d2b-e0d2-4901-a8cc-5abe4c9d914d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.210377 Jan 14 09:47:08.081649 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 178/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:07 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:08.228069 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:08.245792 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:08.247658 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:08.248857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f4bb4da1-b923-4744-8abb-c263d45aa420 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.210504 Jan 14 09:47:08.249407 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 158/336] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:08 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:08.347412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:08.348484 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:08.355794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:08.356246 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.357085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:08.357534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.534622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:08.545355 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-75db85cb-f45e-4ec5-9d07-4012fb223ecd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1509 microversion: 2.1 time: 0.204963 Jan 14 09:47:08.546208 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 179/337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:08 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:08.786567 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:08.787185 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:08.793639 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:08.794122 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.794999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:08.795439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:08.953039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:08.964329 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2efc1d7f-3463-4d14-95a5-7ca12f4ffe41 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1314 microversion: 2.1 time: 0.181515 Jan 14 09:47:08.964927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 159/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:08 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:09.106652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:09.107682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:09.115855 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.116361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.117368 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.117856 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.273317 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:09.274593 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:09.275620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:09.284137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.285316 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.287165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.289725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-38c29ea4-ffbf-44e1-954e-ef0fb50c123a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.187470 Jan 14 09:47:09.290654 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.300614 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 180/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:09 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:09.449957 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:09.460828 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:09.462377 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:09.463585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-60c564ac-502e-46b0-9b62-9dd473316858 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.198071 Jan 14 09:47:09.472911 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 160/340] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:09 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:09.566423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:09.568034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:09.575117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.575554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.576339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.576789 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.763524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:09.775337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e22cc97c-7664-44f3-a7c3-5d4b5b8cdae8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1515 microversion: 2.1 time: 0.213917 Jan 14 09:47:09.776126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 181/341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:09 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:09.985163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:09.985861 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:09.994383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.994860 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:09.995647 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:09.996076 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:10.250062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:10.258855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d4aedd37-eda3-4776-b878-fb33abc57ef1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1497 microversion: 2.1 time: 0.277689 Jan 14 09:47:10.260501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 161/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:09 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:10.317330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:10.318638 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:10.333049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:10.333882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:10.335678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:10.336500 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:10.488132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:10.493245 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:10.493865 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:10.502257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:10.502605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8ab75ed4-ea7c-4793-9b8f-4d23cb02d405 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.193010 Jan 14 09:47:10.502755 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:10.503272 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 182/343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:10 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:10.503534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:10.503971 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:10.661364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:10.671524 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:10.673085 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:10.674292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7e2a512b-53c8-4cb7-b266-72ee27c5bcc2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1744 microversion: 2.20 time: 0.184853 Jan 14 09:47:10.674882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 162/344] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:10 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:11.189297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:11.190852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:11.198781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.199492 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.200572 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.201103 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.247425 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:47:11.349297 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:11.351861 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:11.369514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6bec9e1d-2cbd-45c4-ac4a-cce5ee28b41f tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 204 len: 0 microversion: 2.1 time: 0.184345 Jan 14 09:47:11.370227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 183/345] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:47:11 2022] DELETE /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:47:11.370676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.371325 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.372183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.372702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.387508 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:11.388837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:11.400578 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.401407 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.402966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.404037 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.597164 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:11.607305 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1883835e-9dfb-4b64-8217-614f8772852a tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1503 microversion: 2.1 time: 0.229405 Jan 14 09:47:11.607773 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:11.617298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 184/346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:11 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:11.617298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:11.617298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:11.617659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4f963882-14e4-4131-9566-0c8bc071ab04 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1515 microversion: 2.1 time: 0.276822 Jan 14 09:47:11.618226 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 163/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:11 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:11.634060 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.635796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.635986 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.636508 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.637916 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7755ba2e-5916-47fd-9649-277e9b28d76a"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:11.643033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:11.653226 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.653687 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.654579 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.655020 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.839152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:11.849235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e7e25f93-178a-4285-a7ea-1f05aebfa4f3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.240320 Jan 14 09:47:11.849940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 185/348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:11 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:11.855346 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:11.856026 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:11.862634 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.863112 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.864294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:11.865170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:11.972939 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6de97153-4179-48d0-a5dd-b5eccc1f9d03 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342613 Jan 14 09:47:11.973532 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 164/349] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:47:11 2022] POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:47:12.040748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:12.048933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:12.050648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:12.051846 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e7cc9aa7-5591-4311-b26a-a2fd6dccfbdd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1744 microversion: 2.20 time: 0.200763 Jan 14 09:47:12.052492 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 186/350] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:11 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:12.627131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:12.627740 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:12.634886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:12.635367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:12.636189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:12.636626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:12.786694 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:12.794721 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-10a30fe7-ca52-411e-a945-5b4a3ddf0acc tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1503 microversion: 2.1 time: 0.172787 Jan 14 09:47:12.795317 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 165/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:12 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:12.871191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:12.871889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:12.878925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:12.879538 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:12.880628 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:12.881527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:13.014615 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:13.026209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-313facd9-d3f7-4108-a9de-49cb5b973f53 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.158507 Jan 14 09:47:13.027035 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 187/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:12 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:13.071419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:13.072037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:13.078646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:13.079363 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:13.080689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:13.081288 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:13.230680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:13.238776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:13.240355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:13.241599 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-81365453-d6c1-4990-9c6a-686a03960a20 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1744 microversion: 2.20 time: 0.174336 Jan 14 09:47:13.242137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 166/353] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:13 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:13.817906 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:13.819293 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:13.829050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:13.831694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:13.833950 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:13.835893 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:14.049824 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:14.051400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:14.064405 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:14.064981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:14.065896 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:14.066449 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:14.118401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:14.128369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ce38ccb5-8290-4d3e-b591-b82e4b5002f1 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1503 microversion: 2.1 time: 0.318794 Jan 14 09:47:14.130049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 188/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:13 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:14.260687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:14.261400 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:14.268792 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:14.269236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:14.270029 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:14.270682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:14.456875 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:14.473870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:14.476054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:14.487927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0efb2da4-0b1b-439a-b498-eb7841664354 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.230998 Jan 14 09:47:14.494300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:14.504404 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 189/355] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:14 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:14.507370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f1488b2e-68a4-45a0-b43e-36892c909580 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.464534 Jan 14 09:47:14.507985 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 167/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:14 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:14.842572 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-74c673ff-b548-4951-929b-865a53e56b21 req-06d1a62d-5bd7-48df-999a-c85300b0a760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad", "name": "network-vif-deleted", "tag": "9dd5161b-0034-474f-bd61-d5ee9713786e"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:14.844630 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:47:14.844630 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:47:14.861419 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-74c673ff-b548-4951-929b-865a53e56b21 req-06d1a62d-5bd7-48df-999a-c85300b0a760 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:14.863331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-74c673ff-b548-4951-929b-865a53e56b21 req-06d1a62d-5bd7-48df-999a-c85300b0a760 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:14.890848 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-74c673ff-b548-4951-929b-865a53e56b21 req-06d1a62d-5bd7-48df-999a-c85300b0a760 service nova] Creating event network-vif-deleted:9dd5161b-0034-474f-bd61-d5ee9713786e for instance 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad on hv-cinder-82160 Jan 14 09:47:14.899410 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-74c673ff-b548-4951-929b-865a53e56b21 req-06d1a62d-5bd7-48df-999a-c85300b0a760 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062397 Jan 14 09:47:14.900710 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 190/357] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:47:15.153613 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:15.157562 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:15.203156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.207275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.216001 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.218422 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.378836 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.379604 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.388750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lazy-loading 'fault' on Instance uuid 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:47:15.474126 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44ed39b01c443e92fbbaeed5718fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5dc7c85e0401084a77fbddaa59ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:15.521516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:15.522403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:15.526749 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4348f83f-43f5-412b-867c-2432593fad80 tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 200 len: 1304 microversion: 2.1 time: 0.361335 Jan 14 09:47:15.529705 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 168/358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:15 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 1304 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:15.543044 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.545156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.561535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.566728 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.572763 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:15.578664 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:15.605663 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.606127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.609204 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.609704 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.807882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:15.823577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:15.825942 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:15.827885 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-63cefbea-2a54-4bd1-bf11-6fa00b93c9c0 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.313582 Jan 14 09:47:15.829222 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 191/359] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:15 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:15.887381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-954cfb62-6454-46db-87e9-91529eaac2bf req-ac6f58cd-001b-493d-9217-496bf5359710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "name": "network-vif-plugged", "status": "completed", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:15.892966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:47:15.892966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:47:15.911151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-954cfb62-6454-46db-87e9-91529eaac2bf req-ac6f58cd-001b-493d-9217-496bf5359710 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:15.912602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-954cfb62-6454-46db-87e9-91529eaac2bf req-ac6f58cd-001b-493d-9217-496bf5359710 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:15.928538 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-954cfb62-6454-46db-87e9-91529eaac2bf req-ac6f58cd-001b-493d-9217-496bf5359710 service nova] Creating event network-vif-plugged:7199b4e9-feda-4595-83c7-1a3f330de646 for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a on hv-cinder-82160 Jan 14 09:47:15.935384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-954cfb62-6454-46db-87e9-91529eaac2bf req-ac6f58cd-001b-493d-9217-496bf5359710 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059103 Jan 14 09:47:15.936982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 192/360] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:47:16.130302 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:16.139404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7ee1363b-e210-4616-950b-e0de46dc5508 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.608575 Jan 14 09:47:16.149366 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 169/361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:15 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:16.547051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:16.548412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] [instance: 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:16.559389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:16.560142 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:16.561014 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:16.561667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:16.581013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] HTTP exception thrown: Instance 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad could not be found. Jan 14 09:47:16.582696 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] Returning 404 to user: Instance 6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:47:16.583757 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-40663411-5940-410a-9642-31986d6439ad tempest-VolumesActionsTest-1425675770 tempest-VolumesActionsTest-1425675770-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad" status: 404 len: 111 microversion: 2.1 time: 0.041121 Jan 14 09:47:16.596774 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 193/362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:16 2022] GET /compute/v2.1/servers/6f9627da-ccd6-4ed3-919e-26ca0e4bd0ad => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:47:16.854553 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:16.855979 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:16.870879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:16.872741 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:16.875572 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:16.876215 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:17.056351 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:17.065224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:17.066766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:17.069044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9b907c0f-78ee-4249-95e2-49acfa167d1c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.219215 Jan 14 09:47:17.069799 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 170/363] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:16 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:17.156206 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:17.156830 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:17.164089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:17.164542 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:17.165341 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:17.165776 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:17.404951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:17.450901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a3a1a4b4-af44-4ac6-9352-c5766d657f18 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.297240 Jan 14 09:47:17.452871 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 194/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:17 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:18.092176 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:18.092778 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:18.100390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:18.101118 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:18.101917 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:18.102389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:18.283785 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:18.296760 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:18.300198 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:18.302175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d0d81fb9-8215-46ca-9881-a7d72ad2b9ed tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.213984 Jan 14 09:47:18.321251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 171/365] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:18 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:18.469669 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:18.470327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:18.477646 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:18.478098 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:18.478922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:18.479364 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:18.664513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:18.673157 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fa2a7990-c0ea-4b22-93ce-618e439c0a5d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.207116 Jan 14 09:47:18.688853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 195/366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:18 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:19.321590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:19.322187 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:19.328899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:19.329342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:19.330203 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:19.330666 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:19.525080 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:19.534994 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:19.536908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:19.538623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-09fa930e-557d-4948-a44c-279cda4de745 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.221148 Jan 14 09:47:19.552703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 172/367] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:19 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:19.693659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:19.694849 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:19.705583 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:19.706146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:19.707352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:19.708292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:19.769150 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:19.769746 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:19.778271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:19.778271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:19.778849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:19.779759 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:19.809225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lazy-loading 'flavor' on Instance uuid 468932bd-d6e7-43a5-84f1-53cc479aa7b0 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:47:19.951697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:19.965060 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ad3ba01c-0d71-4ba2-9f09-5475fbdc1f7a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.274873 Jan 14 09:47:19.966068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 196/368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:19 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:19.989677 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bba23365-8147-4bd1-a2de-1bcd9ee06781 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action" status: 200 len: 32 microversion: 2.1 time: 0.225307 Jan 14 09:47:19.994896 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 173/369] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:47:19 2022] POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:47:19.999800 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:20.000696 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:20.007365 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:20.008127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:20.009149 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:20.009759 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:20.263295 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:20.273280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-00be6013-c210-4f4c-9367-933d731262f5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.277230 Jan 14 09:47:20.273899 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 197/370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:19 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:20.568030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:20.570876 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:20.578500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:20.578949 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:20.580459 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:20.580893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:20.907721 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:20.917719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:20.924240 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:20.925470 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-045b294e-6e2f-47ca-ad93-016f4227aea6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.368799 Jan 14 09:47:20.926638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 174/371] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:20 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:20.983406 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:20.984120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:20.991327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:20.992132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:20.993187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:20.993860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:21.232863 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:21.248003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a79b6583-6511-4d9f-9a98-65dcd391a46c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1724 microversion: 2.1 time: 0.268267 Jan 14 09:47:21.248908 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 198/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:20 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:21.293532 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:21.294586 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:21.304228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:21.305199 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:21.308064 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:21.308676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:21.512356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:21.522839 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fdbbaca4-03c8-4e57-96d1-5cf1c1161e36 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.233063 Jan 14 09:47:21.524053 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 175/373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:21 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:21.949551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:21.951106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:21.960438 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:21.961209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:21.963432 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:21.965444 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.211928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:22.221803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:22.223428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:22.224611 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-dcaac771-a7bd-4199-9f53-c0c4a71900fa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.283055 Jan 14 09:47:22.226191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 199/374] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:21 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:22.275900 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:22.277706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:22.287089 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.287716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.288717 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.289326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.545046 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:22.545675 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:22.550058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:22.554133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.554742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.556198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.556640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.579859 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7a598d21-4f68-4473-96e1-316fb6e2656c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1701 microversion: 2.1 time: 0.306836 Jan 14 09:47:22.597936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 176/375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:22 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1701 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:22.603275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4a9ec345-25f9-4d31-9f00-85d28c29d7c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:22.610166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a9ec345-25f9-4d31-9f00-85d28c29d7c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.610725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a9ec345-25f9-4d31-9f00-85d28c29d7c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.636300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4a9ec345-25f9-4d31-9f00-85d28c29d7c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Going to try to start instance {{(pid=128092) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 14 09:47:22.733953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4a9ec345-25f9-4d31-9f00-85d28c29d7c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.130859 Jan 14 09:47:22.740197 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 177/376] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:47:22 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:47:22.747953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:22.749829 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:22.773829 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.776847 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:22.777331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:22.778017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:23.008065 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:23.025215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ebcbf82f-ae6d-4a40-bdc5-e73925036f2e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.484854 Jan 14 09:47:23.027195 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 200/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:22 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:23.043623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:23.059779 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c5b668e7-224d-4815-8c64-7b67a8dd8ef8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1710 microversion: 2.1 time: 0.317467 Jan 14 09:47:23.061101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 178/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:22 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1710 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:23.259864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:23.261304 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:23.273984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:23.292296 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:23.294457 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:23.297493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:23.627394 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:23.647180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:23.651235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:23.653914 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0b3b82b6-6194-4129-aa02-d67a65c492eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.402454 Jan 14 09:47:23.655562 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 201/379] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:23 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:24.050057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:24.051158 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:24.063907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:24.064738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:24.066227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:24.067057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:24.092584 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:24.093610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:24.118634 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:24.122781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:24.125095 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:24.126139 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:24.326875 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:24.341576 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bcbce610-07e1-49b6-9eee-1a10b3134f15 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.297454 Jan 14 09:47:24.345488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 179/380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:24 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:24.408071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:24.417832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f4603a26-5f5b-469b-b2ac-632ba94d52be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1710 microversion: 2.1 time: 0.332158 Jan 14 09:47:24.418927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 202/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:24 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1710 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:24.680324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:24.683932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:24.696510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:24.697062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:24.705926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:24.707150 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:24.880269 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:24.906514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:24.910168 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:24.912703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aea69cfe-1dd0-4895-b2f0-6c05fda46a64 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.240682 Jan 14 09:47:24.915386 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 180/382] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:24 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:25.386496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:25.388472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:25.401574 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:25.402419 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:25.403984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:25.405131 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:25.449283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:25.462390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:25.495441 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:25.496267 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:25.497837 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:25.498864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:25.771447 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:25.789370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8ca14102-bcfb-4380-b49b-43c98c3db170 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1710 microversion: 2.1 time: 0.347502 Jan 14 09:47:25.790872 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 181/383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:25 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1710 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:25.951604 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:25.956344 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:25.974835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:25.985117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:25.986422 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:25.988997 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4ca7a3c8-07db-4f30-934f-729985e3e6e1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.624281 Jan 14 09:47:25.989597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 203/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:25 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:25.991392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:25.998885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:26.367851 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:26.401453 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:26.407412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:26.410711 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a4e80f41-82a7-40bf-aba7-af3d09405ebe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1739 microversion: 2.20 time: 0.471635 Jan 14 09:47:26.412236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 182/385] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:25 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1739 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:26.808241 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:26.815117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:26.826771 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:26.827232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:26.828031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:26.828465 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:26.976329 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:26.988992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-60229ddf-81d6-4a18-ba23-11be2824b7aa tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1710 microversion: 2.1 time: 0.184756 Jan 14 09:47:26.990289 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 204/386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:26 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1710 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:27.017841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:27.019541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:27.039891 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:27.040689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:27.042107 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:27.042889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:27.239786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:27.248061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7de46843-fd38-45f1-be1a-433a28d16917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.235607 Jan 14 09:47:27.248911 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 183/387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:27 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:27.429913 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:27.430597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:27.436927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:27.437384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:27.438179 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:27.438680 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:27.591418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:27.612361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:27.613983 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:27.615203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-87c6be1b-b1a5-4b5f-a06e-ede18b583a58 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1721 microversion: 2.20 time: 0.189173 Jan 14 09:47:27.615767 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 205/388] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:27 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:28.010574 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:28.011882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:28.025635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:28.026292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:28.027087 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:28.027530 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:28.267453 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:28.268137 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:28.275720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:28.276351 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:28.277579 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:28.278265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:28.325555 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:28.339280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-22b8b9da-ece3-4a7c-91cc-60a306f6d5a4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1714 microversion: 2.1 time: 0.335829 Jan 14 09:47:28.341879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 184/389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:28 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1714 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:28.496775 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:28.510864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e320c7ab-8143-47b9-977d-883ea24a0101 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.247037 Jan 14 09:47:28.511832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 206/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:28 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:28.637470 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:28.638662 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:28.645984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:28.646886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:28.647936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:28.648596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:28.842315 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:28.857729 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:28.861346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:28.863853 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2ab16b8c-0c9f-4857-99d5-6947667eca6e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1721 microversion: 2.20 time: 0.229765 Jan 14 09:47:28.864916 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 185/391] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:28 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:29.541488 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:29.542142 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:29.551762 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:29.552902 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:29.553935 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:29.554407 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:29.754488 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:29.773012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6c51d002-7f98-4ac2-acc4-cd4866a8036f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.237450 Jan 14 09:47:29.773621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 207/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:29 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:29.888132 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:29.888728 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:29.900160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:29.900641 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:29.901444 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:29.901882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:30.049671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:30.058030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:30.059546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:30.060705 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d8bcd5d2-9a3b-4e8c-99d7-2fdafc8c4e1a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1721 microversion: 2.20 time: 0.177137 Jan 14 09:47:30.061524 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 186/393] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:29 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:30.794462 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:30.795283 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:30.804266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:30.804718 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:30.805760 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:30.807671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:31.030994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:31.047579 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1762c421-b6bc-4b84-ac1b-5b9b1f50e88a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.259019 Jan 14 09:47:31.049674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 208/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:30 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:31.088712 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:31.091289 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:31.105524 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:31.105983 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:31.107053 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:31.107763 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:31.355251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:31.365895 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:31.369814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:31.372919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-153cff4f-177b-491c-a8b0-9d4184dcdb88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1724 microversion: 2.20 time: 0.287510 Jan 14 09:47:31.390413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 187/395] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:31 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:31.411452 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d787d947-9baf-41f6-b94a-0da3106bdf71"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:31.413948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:31.426140 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:31.427315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:31.429109 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:31.429841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:31.697791 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-5fe00131-846d-4ec2-b8fb-974ee4f33ea8 req-68c13cc3-1fe2-49bd-99e8-bacfcbff420e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:31.700864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:47:31.700864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:47:31.711505 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-5fe00131-846d-4ec2-b8fb-974ee4f33ea8 req-68c13cc3-1fe2-49bd-99e8-bacfcbff420e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:31.712480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-5fe00131-846d-4ec2-b8fb-974ee4f33ea8 req-68c13cc3-1fe2-49bd-99e8-bacfcbff420e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:31.781184 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.compute.server_external_events [req-5fe00131-846d-4ec2-b8fb-974ee4f33ea8 req-68c13cc3-1fe2-49bd-99e8-bacfcbff420e service nova] Unable to find a host for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a. Dropping event network-vif-unplugged {{(pid=128092) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 14 09:47:31.785891 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-5fe00131-846d-4ec2-b8fb-974ee4f33ea8 req-68c13cc3-1fe2-49bd-99e8-bacfcbff420e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091334 Jan 14 09:47:31.790983 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 188/396] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 99 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 14 09:47:32.027211 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e4260043-fd6d-4df0-874b-02974da6a9bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.625264 Jan 14 09:47:32.028768 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 209/397] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jan 14 09:47:31 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments => generated 188 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:47:32.069382 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:32.070703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:32.084135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:32.085207 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:32.087010 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:32.088114 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:32.269632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:32.270215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:32.286069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:32.286838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:32.287842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:32.288445 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:32.351195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:32.360912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2ca9ca63-18cb-4aec-8889-fda405a707a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.297650 Jan 14 09:47:32.370454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 189/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:32 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:32.421505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1dd981ad-8ae3-4edd-83a2-2dae7e2cc825 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action" status: 202 len: 0 microversion: 2.20 time: 0.155621 Jan 14 09:47:32.423570 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 210/399] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:47:32 2022] POST /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:47:32.431932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:32.433002 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:32.440360 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:32.441098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:32.442159 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:32.442933 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:32.609564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:32.622560 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:32.624703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:32.626779 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-42c80912-b788-4a84-a5b1-135c66617581 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.198864 Jan 14 09:47:32.627602 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 190/400] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:32 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:33.386163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:33.388573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:33.401193 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:33.401957 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:33.403652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:33.404589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:33.592297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:33.602009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-805e2ec3-e7ca-4fff-9ba7-ca3bef255d82 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.222670 Jan 14 09:47:33.603121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 211/401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:33 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:33.645585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:33.646317 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:33.656185 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:33.656974 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:33.657788 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:33.658227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:33.820797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:33.829951 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:33.831615 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:33.832913 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0899eb25-476b-4657-b3b8-1f2706e47ffe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.191660 Jan 14 09:47:33.833555 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 191/402] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:33 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:34.636267 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:34.637870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:34.655970 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:34.660100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:34.663446 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:34.675779 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:34.854473 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:34.855104 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:34.885100 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:34.886806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:34.897130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:34.897780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:34.930671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:34.963860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fca06317-63c4-4c89-8e2a-882b6d15030e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.338683 Jan 14 09:47:34.978704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 212/403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:34 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:35.156625 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:35.175385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:35.177677 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:35.179660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6f375502-8454-435e-8e84-f800dc6e7abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.328696 Jan 14 09:47:35.180975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 192/404] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:34 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:35.226631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1181b556-e6a1-4edf-a67c-f1342636a151", "device": "/dev/sdb"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:47:35.228345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:35.234656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:35.235491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:35.236344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:35.236749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:35.547117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-63689e3a-a964-47dc-a91a-d78000ce706f tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "POST /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323896 Jan 14 09:47:35.548253 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 213/405] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:47:35 2022] POST /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:47:35.984600 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:35.986248 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:35.995444 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:35.995960 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:35.996886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:35.997720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:36.189645 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:36.203552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:36.204349 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:36.205307 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0b1dc275-1231-418b-9a49-a39934a1a6f9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.225537 Jan 14 09:47:36.215271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 193/406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:35 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:36.215524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:36.215524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:36.215524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:36.216085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:36.420658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:36.432597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:36.434122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:36.442205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-aab0e740-45ea-43b8-8c08-2fe7f09e6333 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.243581 Jan 14 09:47:36.444019 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 214/407] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:36 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:37.226007 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:37.226825 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:37.236041 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:37.236701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:37.238138 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:37.239030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:37.465991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:37.473167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:37.483100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:37.484290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:37.486041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:37.487100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:37.495518 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:37.510899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a0484e73-b593-4e17-a272-bb590caa5649 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.288100 Jan 14 09:47:37.512653 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 194/408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:37 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:37.751823 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:37.768797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:37.772681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:37.775351 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-acee996d-14df-4a7f-bade-ef8022449ee1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.315365 Jan 14 09:47:37.790873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 215/409] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:37 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:38.541366 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:38.542286 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:38.552601 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:38.553640 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:38.555219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:38.556210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:38.808689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:38.824788 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:38.844936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:38.850688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:38.852593 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:38.855807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:38.925983 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:38.962532 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-67364a67-b39c-40c1-85c6-8e21ea7de660 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.419862 Jan 14 09:47:38.975498 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 195/410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:38 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:39.131476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:39.148059 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:39.152200 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:39.154833 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a0c93f4e-f2ea-4583-92ec-ccb79a698893 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.350188 Jan 14 09:47:39.157029 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 216/411] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:38 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:39.989660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:39.991276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:39.997987 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:39.998460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:39.999505 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:39.999925 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:40.178225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:40.179659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:40.185088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:40.187187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:40.188498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:40.189558 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:40.190228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:40.205885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8092af96-6982-4d3f-9313-4f480ffda5f1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.221127 Jan 14 09:47:40.206925 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 196/412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:39 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:40.383559 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:40.393590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:40.399717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:40.401192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f87a4cea-0ac7-43d0-981e-ae2c93a80d29 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.226786 Jan 14 09:47:40.413749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 217/413] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:40 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:41.228655 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:41.230026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:41.238205 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:41.238679 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:41.239549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:41.239993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:41.409624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:41.419053 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5c0395c0-e7aa-4ed9-b981-be5b443fbf09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.198196 Jan 14 09:47:41.420799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:41.422887 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:41.429475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 197/414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:41 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:41.429666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:41.429939 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:41.430796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:41.431237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:41.620325 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:41.629864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:41.631883 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:41.633286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-87350b31-0d06-493f-868e-0cbfdfe7b135 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.216202 Jan 14 09:47:41.634325 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 218/415] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:41 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:42.440594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:42.442290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:42.450271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:42.450975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:42.452300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:42.453326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:42.621565 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:42.632047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d3673099-9cac-451c-8b12-36b37375cf98 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.197729 Jan 14 09:47:42.634708 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 198/416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:42 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:42.654487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:42.655123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:42.662040 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:42.662523 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:42.663683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:42.665658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:42.843063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:42.853443 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:42.854992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:42.856196 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1251d934-db1b-4dd1-bd32-b86239e66b5f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.205729 Jan 14 09:47:42.868225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 219/417] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:42 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:43.651808 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:43.653701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:43.668043 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:43.669260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:43.670494 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:43.671175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:43.832244 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:43.845971 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0e964265-88c5-4f78-9a0a-ef94bd053160 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.199881 Jan 14 09:47:43.847034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 199/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:43 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:43.881426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:43.882179 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:43.899400 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:43.899859 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:43.900679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:43.901119 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:44.091012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:44.099755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:44.101257 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:44.102450 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6ae6c5db-3f94-4d28-8640-a31dd591b987 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.225065 Jan 14 09:47:44.103005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 220/419] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:43 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:44.872741 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:44.873997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:44.883365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:44.883960 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:44.885367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:44.886174 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:45.036397 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:45.046228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ae5ac9eb-14c1-4186-8fe3-96c92bf01967 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.177503 Jan 14 09:47:45.046907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 200/420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:44 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:45.120911 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:45.121534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:45.128604 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:45.129065 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:45.129869 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:45.130310 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:45.284691 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:45.293741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:45.295786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:45.298531 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2a01ce84-121b-4394-9a65-be02b81dfbf2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.180856 Jan 14 09:47:45.300308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 221/421] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:45 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:46.063062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:46.063899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:46.072323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:46.072774 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:46.076514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:46.083292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:46.312074 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:46.323559 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:46.324232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:46.342166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f1ef0bdf-bae3-4542-9108-cb46adce0826 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.283427 Jan 14 09:47:46.345483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:46.345942 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:46.346784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:46.347228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:46.350145 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 201/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:46 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:46.528353 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:46.538397 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:46.539936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:46.541144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f0196f78-2dd2-4be4-937c-e365b2845619 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1750 microversion: 2.20 time: 0.225318 Jan 14 09:47:46.541708 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 222/423] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:46 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1750 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:47.359246 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:47.359856 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:47.366446 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:47.366901 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:47.367699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:47.368135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:47.503473 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:47.512807 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3dfee9b5-e720-41e0-83f4-a34019d6f0bc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.157200 Jan 14 09:47:47.513389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 202/424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:47 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:47.559757 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:47.560364 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:47.567863 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:47.568323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:47.569118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:47.569555 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:47.713710 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:47.723105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:47.724601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:47.725782 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-006c6882-3af6-42c2-9745-69320cd0aabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1752 microversion: 2.20 time: 0.169757 Jan 14 09:47:47.726341 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 223/425] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:47 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:48.534062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:48.535386 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:48.541345 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:48.541803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:48.542638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:48.543079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:48.682589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:48.697082 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-db745b2a-85d5-4346-b853-dd4be15a31d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.167282 Jan 14 09:47:48.697664 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 203/426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:48 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:48.753147 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:48.753791 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:48.760102 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:48.760554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:48.761332 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:48.761772 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:48.894967 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:48.903314 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:48.904805 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:48.905961 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e6974b20-11c5-4597-b157-8951c06e3009 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1752 microversion: 2.20 time: 0.157016 Jan 14 09:47:48.906543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 224/427] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:48 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:49.714608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:49.715219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:49.721626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:49.722073 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:49.722885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:49.723325 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:49.870948 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:49.885196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c2e1df91-f463-423b-9034-9c5207ae2e84 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.174171 Jan 14 09:47:49.886061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 204/428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:49 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:49.924643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:49.925263 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:49.937216 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:49.937681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:49.938526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:49.938970 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:50.156719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:50.167595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:50.169841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:50.171666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6c9d9855-da29-4a7b-8f8c-ff1a30b7b696 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1752 microversion: 2.20 time: 0.250604 Jan 14 09:47:50.172631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 225/429] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:49 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1752 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:50.905615 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:50.907701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:50.918597 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:50.919453 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:50.920559 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:50.921390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:51.113443 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:51.122653 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b7c436d9-f6af-421a-873d-69f2a812416c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.221140 Jan 14 09:47:51.123356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 205/430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:50 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:47:51.195218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:51.196437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:51.204058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:51.204687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:51.205595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:51.206127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:51.408439 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:51.423888 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:51.426423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:51.428659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6f9dd257-6209-44fd-a0d6-84240dcaedcf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.236757 Jan 14 09:47:51.430452 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 226/431] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:51 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:52.144577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:52.145995 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:52.153640 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:52.154401 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:52.155206 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:52.155634 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:52.322728 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:52.335096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c90ddc45-9e7d-4664-8b36-532c7db37cc9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.196229 Jan 14 09:47:52.336282 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 206/432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:52 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:52.474510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:52.484831 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:52.508270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:52.509654 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:52.511566 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:52.513243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:52.759131 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:52.802301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:52.805263 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:52.810053 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4afe4613-81f0-4445-9e02-d6c94d71034b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.342580 Jan 14 09:47:52.812933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 227/433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:52 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:53.364961 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:53.366191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:53.374390 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:53.375260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:53.376177 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:53.376624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:53.683659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:53.697918 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5b88c0fe-7e35-4360-9784-cf457325e5dd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.336652 Jan 14 09:47:53.712568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 207/434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:53 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:53.832344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:53.834008 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:53.842464 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:53.842933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:53.843817 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:53.844258 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:54.034916 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:54.049853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:54.051607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:54.052938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2b7c87a6-d754-4e4f-b95f-e44d1d9fec33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.225269 Jan 14 09:47:54.053507 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 228/435] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:53 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:54.715806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:54.716533 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:54.730323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:54.730932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:54.731540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:54.731980 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:55.072582 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:55.073217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:55.083178 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:55.084390 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:55.085401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:55.086013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:55.111214 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:55.123193 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e595a6f9-f15c-47b8-9ec4-fe9a3bb9b0d5 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.411414 Jan 14 09:47:55.128234 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 208/436] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:54 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:55.384049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:55.397981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:55.400853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:55.402206 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c3811f27-f5a9-43fb-83ee-a19e51796ec7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.334120 Jan 14 09:47:55.403337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 229/437] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:55 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:56.146291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:56.147075 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:56.153685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:56.154134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:56.154976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:56.155433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:56.312991 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:56.321477 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-73432e46-c283-43e8-8a82-94c32c08d951 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.178765 Jan 14 09:47:56.322326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 209/438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:56 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:56.433009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:56.433809 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:56.441276 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:56.441736 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:56.442666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:56.443106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:56.598128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:56.611624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:56.613213 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:56.614489 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bb4cce04-a952-4964-b09e-bd0046a582bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.186671 Jan 14 09:47:56.615083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 230/439] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:56 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:57.343430 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:57.344163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:57.351513 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:57.351957 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:57.352885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:57.353320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:57.508275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:57.517016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3915da45-a1da-42c0-92d9-2843149741be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.177474 Jan 14 09:47:57.517929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 210/440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:57 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:57.632580 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:57.633217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:57.639740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:57.640258 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:57.641023 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:57.641461 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:57.786658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:57.797588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:57.799484 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:57.800980 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c43cbee7-f28d-4652-ae94-7e492d71c94c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.172075 Jan 14 09:47:57.801916 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 231/441] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:57 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:47:58.534961 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:58.535525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:58.547940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:58.548385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:58.549251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:58.554163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:58.824693 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:58.827329 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:58.839782 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:58.841717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:58.846927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:58.847992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:58.875798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:58.888076 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7f026460-de0d-4c2f-b4a4-6126b858991b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.357455 Jan 14 09:47:58.889544 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 211/442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:58 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:47:59.089996 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:59.109485 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:59.113938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:47:59.117615 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b0d7a961-d0c4-4c19-9be4-2706826e9ade tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.300320 Jan 14 09:47:59.131177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 232/443] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:47:58 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:47:59.911241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:47:59.911859 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:47:59.932866 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:59.933771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:47:59.935066 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:47:59.935932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:00.101704 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:00.113394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-74d3f3c7-db88-41f1-989b-c25cb022dcfa tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.205611 Jan 14 09:48:00.118405 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 212/444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:47:59 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:00.136836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:00.137443 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:00.158601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:00.159046 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:00.159851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:00.160301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:00.336852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:00.348794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:00.353847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:00.355263 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3b56bd98-1ac7-4f11-91ae-82a99461e0d9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.221947 Jan 14 09:48:00.356086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 233/445] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:00 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:01.139751 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:01.140440 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:01.147033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:01.147476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:01.148262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:01.148694 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:01.294485 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:01.310238 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0ad866af-85cc-411b-9f34-506b64bf7108 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.173730 Jan 14 09:48:01.311649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 213/446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:01 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:01.380750 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:01.381473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:01.392392 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:01.392842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:01.393837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:01.394231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:01.542529 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:01.552305 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:01.553925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:01.555404 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-094e2614-104a-45a1-8d38-cb27f317eb33 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.181840 Jan 14 09:48:01.556362 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 234/447] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:01 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:48:02.339961 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:02.340620 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:02.347083 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:02.347538 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:02.348484 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:02.348919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:02.500806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:02.521577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-add97c34-f30d-4587-968e-f11ae6eaa60d tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.184831 Jan 14 09:48:02.522969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 214/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:02 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:02.575514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:02.576604 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:02.582624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:02.583048 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:02.583911 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:02.584287 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:02.760198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:02.776140 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:02.777678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:02.778932 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-69e9d8b5-866b-49dd-943e-e3c5e4cfa3eb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.208673 Jan 14 09:48:02.779836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 235/449] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:02 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:03.540633 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:03.541266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:03.547577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:03.548111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:03.548887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:03.549317 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:03.679727 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:03.688669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-38925e87-b648-4033-8374-fc951d94d3be tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.151937 Jan 14 09:48:03.689239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 215/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:03 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:03.802935 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:03.803601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:03.810202 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:03.810936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:03.812265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:03.812696 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:03.975464 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:03.984833 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:03.986327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:03.987698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6acd2843-0ca9-4584-8df4-5c0a1b594a56 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.188557 Jan 14 09:48:03.988265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 236/451] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:03 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:04.709993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:04.710714 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:04.719626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:04.720088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:04.720904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:04.721345 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:04.896939 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:04.905936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-adf10482-e730-437e-9cfa-82043ecebace tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.203401 Jan 14 09:48:04.906786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 216/452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:04 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:05.014167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:05.015257 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:05.021865 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:05.022306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:05.023123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:05.023764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:05.181573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:05.191927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:05.193931 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:05.195785 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-04abb968-fcc3-40a4-ba70-3f0762110e21 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.185187 Jan 14 09:48:05.197091 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 237/453] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:05 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:05.923782 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:05.924602 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:05.931512 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:05.931966 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:05.932761 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:05.933200 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:06.083820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:06.093198 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-244dcf7b-8580-43ef-b540-b86083dc2c8c tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.173165 Jan 14 09:48:06.094488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 217/454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:05 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:06.215448 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:06.216133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:06.223155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:06.223613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:06.224418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:06.224854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:06.379978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:06.391864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:06.393345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:06.394540 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-db297f8c-a29d-4056-a492-21fc759e44cc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.183352 Jan 14 09:48:06.395081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 238/455] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:06 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:07.109823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:07.110496 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:07.116940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:07.117394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:07.118254 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:07.118737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:07.259479 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:07.268342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f3289777-ebb7-4646-9c65-9946c4da0fa3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.162167 Jan 14 09:48:07.268910 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 218/456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:07 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:07.417643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:07.418372 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:07.424461 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:07.424906 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:07.425675 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:07.426109 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:07.578902 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:07.587767 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:07.589255 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:07.590425 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3efe666e-c03b-451d-87f2-8286b9138601 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.176411 Jan 14 09:48:07.590984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 239/457] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:07 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:08.285908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:08.287329 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:08.300352 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:08.300899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:08.302143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:08.305586 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:08.461787 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:08.470231 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1e2a47df-aa2a-445f-9a47-4b8303868882 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.188855 Jan 14 09:48:08.470843 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 219/458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:08 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:08.612368 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:08.612991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:08.631132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:08.631586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:08.632565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:08.633004 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:08.637360 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:08.637885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:08.645039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:08.645784 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:08.647199 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:08.648136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:08.793956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lazy-loading 'services' on Instance uuid 7b470a71-5d32-4dc8-895f-4a0e54d002d5 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:48:08.867773 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:08.887663 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:08.890479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:08.892455 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2ce04d3d-4dde-4c9d-9803-4153b0321fb3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.286825 Jan 14 09:48:08.902410 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 240/459] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:08 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:08.948258 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-de7110f6-87af-49f1-b08b-5e3550a9b972 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5/os-volume_attachments/1181b556-e6a1-4edf-a67c-f1342636a151" status: 202 len: 0 microversion: 2.1 time: 0.314543 Jan 14 09:48:08.948886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 220/460] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:48:08 2022] DELETE /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5/os-volume_attachments/1181b556-e6a1-4edf-a67c-f1342636a151 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:48:09.487066 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:09.487715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:09.494035 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:09.494565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:09.495451 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:09.495915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:09.645601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:09.653570 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c4b2d2d0-0419-4fc2-a192-a9a515c9fd52 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.170142 Jan 14 09:48:09.654143 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 241/461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:09 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:09.911520 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:09.912223 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:09.918678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:09.919144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:09.919976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:09.920527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:10.060627 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:10.073074 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:10.074823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:10.076341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f22230ed-eade-4cd0-b0ba-320f9227b968 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.169312 Jan 14 09:48:10.077049 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 221/462] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:09 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:10.670618 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:10.671785 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:10.677960 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:10.678443 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:10.679231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:10.679673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:10.821710 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:10.829965 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d7666a47-736d-4de7-b331-e890aaff07ce tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.162901 Jan 14 09:48:10.830585 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 242/463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:10 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:11.099552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:11.101212 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:11.125144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:11.127804 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:11.130110 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:11.130587 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:11.346718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:11.355371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:11.356889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:11.358068 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-cab5493b-1355-49f9-a6c9-e6c43982413c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.263571 Jan 14 09:48:11.359208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 222/464] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:11 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:11.847936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:11.849188 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:11.865699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:11.866500 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:11.867511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:11.867960 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:12.193173 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:12.216765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f38bb401-7157-4f00-8e17-2889bcee1b56 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.370728 Jan 14 09:48:12.218187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 243/465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:11 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:12.377812 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:12.378437 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:12.391367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:12.391857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:12.392682 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:12.393120 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:12.687519 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:12.696738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:12.699474 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:12.700419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3a5b5332-07de-45b4-88db-56b079b6b552 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.327235 Jan 14 09:48:12.700999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 223/466] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:12 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:13.232991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:13.233602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:13.241902 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:13.242364 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:13.243222 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:13.243655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:13.468543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:13.478422 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d50c3109-4077-4f6c-a3ca-be2d8d1219c7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1567 microversion: 2.1 time: 0.248842 Jan 14 09:48:13.479641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 244/467] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:13 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:13.725917 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:13.730014 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:13.755393 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:13.756234 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:13.757340 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:13.758002 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.076041 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:14.086833 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:14.088901 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:14.090378 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-db235ec4-8d50-4e3e-879c-f133e96848b3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.375196 Jan 14 09:48:14.091590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 224/468] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:13 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:14.495834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:14.496522 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:14.504754 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:14.505597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.506660 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:14.507301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.668355 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:14.677367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-642694eb-8e3f-4e05-9f79-9b01dc435efc tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1547 microversion: 2.1 time: 0.185230 Jan 14 09:48:14.691352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 245/469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:14 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1547 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:14.699048 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:14.700010 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:14.709104 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:14.709952 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.710956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:14.711576 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.817852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] HTTP exception thrown: Cannot 'detach_volume' instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 while it is in vm_state rescued Jan 14 09:48:14.820080 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Returning 409 to user: Cannot 'detach_volume' instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 while it is in vm_state rescued {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:48:14.826582 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-da76cc0e-0c1e-4a8c-86f4-534babfe32b8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "DELETE /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments/7755ba2e-5916-47fd-9649-277e9b28d76a" status: 409 len: 152 microversion: 2.1 time: 0.131998 Jan 14 09:48:14.830808 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 225/470] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:48:14 2022] DELETE /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments/7755ba2e-5916-47fd-9649-277e9b28d76a => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 14 09:48:14.844187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:14.845800 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:14.860882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:14.863306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.865574 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:14.866825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:14.983624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-dfb9caf7-4b2a-4e1a-9e95-3cf084c6200f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.150240 Jan 14 09:48:14.985169 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 246/471] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:48:14 2022] POST /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:48:14.993443 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:14.994041 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:15.009783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.012117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.013968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.015017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.114880 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:15.115663 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:15.139645 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.140668 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.142552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.143918 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.355101 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:15.374699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:15.378273 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:15.380648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4c3f9cd3-77ce-4497-9d2f-287b62ef4153 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.274594 Jan 14 09:48:15.382471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 247/472] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:15 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:15.487174 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:15.488226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:15.497441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.498459 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.500600 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.505880 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.535049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:48:15.609250 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:15.619941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0ff9f91f-a86a-4002-92e3-0dafe5225071 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.630309 Jan 14 09:48:15.624311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 226/473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:14 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:15.643481 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-427dc340-8f75-4c0b-8f99-b026b9678ae8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 204 len: 0 microversion: 2.1 time: 0.169213 Jan 14 09:48:15.644611 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 248/474] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:48:15 2022] DELETE /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:48:15.652142 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:15.652905 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:15.660986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.661723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:15.663298 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:15.663982 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:16.422033 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:16.423511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:16.430592 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:16.431353 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:16.432423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:16.433155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:16.596829 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:16.606059 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f3b5561b-70b3-4f09-a145-80889d185eb0 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1514 microversion: 2.1 time: 0.957402 Jan 14 09:48:16.607395 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 227/475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:15 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1514 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:16.633402 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:16.642614 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:16.643337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:16.643638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:16.645046 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:16.646310 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4a01f9b9-9ba5-4aac-9694-ee0fbca706d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.229531 Jan 14 09:48:16.648360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 249/476] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:16 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:16.654305 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:16.659984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:16.660867 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:16.661319 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:17.138270 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:17.146767 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aaad6c3d-4adb-453c-9a69-d3f3ec2ed228 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.508145 Jan 14 09:48:17.147752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 228/477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:16 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:17.635551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:17.638268 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:17.662430 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:17.662895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:17.663713 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:17.664794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:17.672499 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:17.678285 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:17.695059 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:17.698669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:17.700689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:17.702234 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:17.981772 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:17.997015 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b2b5a4ec-bb2f-422e-bfb7-9da11d1fbfb1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1514 microversion: 2.1 time: 0.370634 Jan 14 09:48:17.997623 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 250/478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:17 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:18.164838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:18.165449 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:18.174688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:18.175148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:18.178543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:18.178989 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:18.279007 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:18.296042 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:18.299685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:18.301266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-11609fd3-273d-4955-abd8-d85f14b74a88 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.637249 Jan 14 09:48:18.303543 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 229/479] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:17 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:18.518249 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:18.526587 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0b178813-02b6-4b36-b1a7-0b4a21e1d941 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.365299 Jan 14 09:48:18.530511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 251/480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:18 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:18.559300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-660cedbc-8b15-407b-9dd6-48c7e4762cf5 req-61993e1c-b6a4-4d42-956d-d4fdd2c8d004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b470a71-5d32-4dc8-895f-4a0e54d002d5", "name": "network-vif-deleted", "tag": "069c8609-2930-41ad-9021-3efaee2425f5"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:18.561321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:18.561321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:48:18.568710 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-660cedbc-8b15-407b-9dd6-48c7e4762cf5 req-61993e1c-b6a4-4d42-956d-d4fdd2c8d004 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:18.569156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-660cedbc-8b15-407b-9dd6-48c7e4762cf5 req-61993e1c-b6a4-4d42-956d-d4fdd2c8d004 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:18.581302 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-660cedbc-8b15-407b-9dd6-48c7e4762cf5 req-61993e1c-b6a4-4d42-956d-d4fdd2c8d004 service nova] Creating event network-vif-deleted:069c8609-2930-41ad-9021-3efaee2425f5 for instance 7b470a71-5d32-4dc8-895f-4a0e54d002d5 on hv-cinder-82160 Jan 14 09:48:18.586545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-660cedbc-8b15-407b-9dd6-48c7e4762cf5 req-61993e1c-b6a4-4d42-956d-d4fdd2c8d004 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031281 Jan 14 09:48:18.587148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 230/481] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:19.017581 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:19.018231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:19.024584 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:19.025317 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:19.026307 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:19.027166 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:19.108226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:19.116505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4517bcac-12c8-4074-bedc-1299f0737ad6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1472 microversion: 2.1 time: 0.106672 Jan 14 09:48:19.124202 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 252/482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:19 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1472 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:19.331556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:19.333208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:19.340601 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:19.341311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:19.343102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:19.344346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:19.517341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:19.527562 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:19.530600 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:19.532193 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bee5c007-8a9f-4ad6-bb38-7dcc00fc1a72 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.206451 Jan 14 09:48:19.534198 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 231/483] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:19 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:19.547524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:19.548377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:19.554040 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:19.554704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:19.555687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:19.556120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:19.784209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:19.792358 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-14770a69-67d1-4e51-8d91-85eee92d7d25 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.248438 Jan 14 09:48:19.793019 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 253/484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:19 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:20.133133 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:20.134203 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:20.140145 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:20.140950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:20.141962 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:20.142767 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:20.209776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:20.217937 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5e124665-483e-4088-b2b8-b0ee59cceb68 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1472 microversion: 2.1 time: 0.087645 Jan 14 09:48:20.219537 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 232/485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:20 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1472 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:20.551059 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:20.552327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:20.559369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:20.560102 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:20.561405 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:20.562026 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:20.809251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:20.810971 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:20.826242 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:20.827880 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:20.829037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:20.829494 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:21.167154 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:21.178604 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:21.180993 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:21.182459 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-da656414-c008-4ba4-904a-7ed941fdb68c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.635199 Jan 14 09:48:21.183570 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 254/486] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:20 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:21.215938 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:21.226478 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c7e27b75-d6d5-4fbb-ac24-94a5f2cee4f3 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.420962 Jan 14 09:48:21.228199 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 233/487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:20 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:21.242505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:21.243357 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:21.250113 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:21.250595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:21.251412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:21.252077 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:21.291103 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:21.291827 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:21.292494 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lazy-loading 'fault' on Instance uuid 7b470a71-5d32-4dc8-895f-4a0e54d002d5 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:48:21.355821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:21.366577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ebcfa27b-927a-49bb-be22-197039826eda tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1309 microversion: 2.1 time: 0.128106 Jan 14 09:48:21.367787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 255/488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:21 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:22.201501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:22.202258 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:22.212488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.213642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.215850 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.216460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.244344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:22.245273 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:22.253562 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.254488 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.256113 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.256879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.433959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:22.446643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d40f3800-b964-4e2d-b348-cd6b1ee6d0bd tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.205853 Jan 14 09:48:22.458286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 256/489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:22 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:22.465510 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:22.466440 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:22.474955 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.475680 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.476666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.477270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.535927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:22.536635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:22.536852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lazy-loading 'fault' on Instance uuid 7b470a71-5d32-4dc8-895f-4a0e54d002d5 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:48:22.600196 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:22.613698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5b0dc74a-97a3-4cbb-868e-500dc579353c tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1309 microversion: 2.1 time: 0.152430 Jan 14 09:48:22.625293 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 257/490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:22 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:22.681534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:22.694800 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:22.706301 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:22.708027 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-45a7f3ef-0c6b-4671-8303-5825c37738d5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.510735 Jan 14 09:48:22.708875 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 234/491] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:22 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:23.468622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:23.470609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:23.489930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.493064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.494207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.495731 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.632706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:23.633399 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:23.642969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.646104 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.647241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.647914 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.683783 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:23.709374 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-84dd71ac-ab80-4dfc-a2ae-2506254fb131 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1555 microversion: 2.1 time: 0.246000 Jan 14 09:48:23.710005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 258/492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:23 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:23.723615 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.724327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.725002 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lazy-loading 'fault' on Instance uuid 7b470a71-5d32-4dc8-895f-4a0e54d002d5 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:48:23.731999 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:23.733143 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:23.744277 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.744897 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.745711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:23.746155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:23.784492 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:23.795581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7888f501-6e6a-4a49-8b4e-941b090e5665 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 200 len: 1309 microversion: 2.1 time: 0.166106 Jan 14 09:48:23.796608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 235/493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:23 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:23.999096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:24.011504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:24.013700 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:24.015639 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-42ced083-cd50-493d-a27a-7760c5e61328 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.287417 Jan 14 09:48:24.027551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 259/494] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:23 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:24.725811 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:24.726465 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:24.739347 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:24.740341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:24.741146 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:24.741776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:24.819982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:24.825679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: 7b470a71-5d32-4dc8-895f-4a0e54d002d5] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:24.834327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:24.835114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:24.839588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:24.840420 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:24.863379 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] HTTP exception thrown: Instance 7b470a71-5d32-4dc8-895f-4a0e54d002d5 could not be found. Jan 14 09:48:24.864267 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Returning 404 to user: Instance 7b470a71-5d32-4dc8-895f-4a0e54d002d5 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:48:24.865276 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-dff0dfff-347b-493e-a62b-b342c21e50a8 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5" status: 404 len: 111 microversion: 2.1 time: 0.056092 Jan 14 09:48:24.870195 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 260/495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:24 2022] GET /compute/v2.1/servers/7b470a71-5d32-4dc8-895f-4a0e54d002d5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:48:24.947908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:24.971404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c22ade5a-2b7a-4402-92b7-12a9c5072d09 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1561 microversion: 2.1 time: 0.249128 Jan 14 09:48:24.973546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 236/496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:24 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1561 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:25.033814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:25.034805 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:25.042078 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:25.048250 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:25.049839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:25.050268 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:25.173814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:25.174626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:25.204712 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:25.207527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:25.209403 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:25.212592 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:25.313414 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:25.326946 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:25.332373 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:25.336998 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-63c917a5-1dfe-444a-8e2c-b2cc6762439c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.305840 Jan 14 09:48:25.349361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 261/497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:25 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:25.371222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lazy-loading 'services' on Instance uuid 468932bd-d6e7-43a5-84f1-53cc479aa7b0 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:48:25.482154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aee9fd59-de60-48bf-b8b6-b082fc7c3d40 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "DELETE /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments/7755ba2e-5916-47fd-9649-277e9b28d76a" status: 202 len: 0 microversion: 2.1 time: 0.314145 Jan 14 09:48:25.482954 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 237/498] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:48:25 2022] DELETE /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments/7755ba2e-5916-47fd-9649-277e9b28d76a => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:48:25.491824 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:25.493234 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:25.500816 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:25.511117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:25.512359 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:25.513683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:25.578092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-43cbb2d1-70bc-4012-8a81-edc14d3eb311 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090464 Jan 14 09:48:25.582218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 262/499] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:48:25 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:26.360558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:26.362575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:26.376894 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:26.377747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:26.379843 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:26.382063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:26.596287 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:26.608931 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:26.627854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:26.633105 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:26.634242 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:26.635316 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:26.635929 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:26.646387 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:26.647419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:26.648748 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6908bf70-f602-4849-b476-b66870ce55f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.296810 Jan 14 09:48:26.658381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 238/500] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:26 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:26.691015 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6221f323-980f-4ca7-9229-782d6489b255 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103146 Jan 14 09:48:26.692370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 263/501] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:48:26 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:27.442835 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-c1dc371d-10b6-423d-9be2-66bb56d96190 req-d777c36b-6e60-4792-ac22-339d1ac021df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "name": "network-vif-plugged", "status": "completed", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:27.445402 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:27.445402 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:48:27.454997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-c1dc371d-10b6-423d-9be2-66bb56d96190 req-d777c36b-6e60-4792-ac22-339d1ac021df service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:27.455730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-c1dc371d-10b6-423d-9be2-66bb56d96190 req-d777c36b-6e60-4792-ac22-339d1ac021df service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:27.468698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-c1dc371d-10b6-423d-9be2-66bb56d96190 req-d777c36b-6e60-4792-ac22-339d1ac021df service nova] Creating event network-vif-plugged:7199b4e9-feda-4595-83c7-1a3f330de646 for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a on hv-cinder-82160 Jan 14 09:48:27.476588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-c1dc371d-10b6-423d-9be2-66bb56d96190 req-d777c36b-6e60-4792-ac22-339d1ac021df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037892 Jan 14 09:48:27.477545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 239/502] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:48:27.669858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:27.670511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:27.686508 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:27.687031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:27.688280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:27.688601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:27.706259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:27.707903 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:27.760784 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:27.761282 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:27.762117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:27.779732 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:27.819486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e7fe497d-9204-4c8a-a9aa-e3c7d535336e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120396 Jan 14 09:48:27.820808 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 240/503] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:48:27 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:48:27.972448 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:27.985708 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:27.990330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:27.991886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6cf14a95-0a33-4551-ad01-987f1c424791 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.325934 Jan 14 09:48:27.993020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 264/504] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:27 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:28.833215 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:28.835004 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:28.844147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:28.844892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:28.846525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:28.849738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:28.914188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-852c1263-441c-4d4d-893f-552587edafd1 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084604 Jan 14 09:48:28.919448 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 241/505] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:48:28 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:29.013411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:29.014840 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:29.024330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:29.025183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:29.028067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:29.029054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:29.312133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:29.322180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:29.325688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:29.325688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-05e84a42-1fb1-4c5c-8037-9ccce16dd521 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.318162 Jan 14 09:48:29.336903 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 265/506] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:29 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:29.928750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:29.930316 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:29.938026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:29.939262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:29.940730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:29.943998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:29.991484 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9d55f05b-5dba-40df-b4cf-70e1d0c4fdc8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066264 Jan 14 09:48:29.992158 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 242/507] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:48:29 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:48:30.343518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:30.345749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:30.379180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:30.380009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:30.385850 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:30.386315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:30.580832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:30.594435 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:30.596780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:30.598526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-db85f4f9-eb16-4cea-abc2-b39ec82697bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.258434 Jan 14 09:48:30.600165 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 266/508] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:30 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:31.620698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:31.621321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:31.629218 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:31.629964 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:31.631008 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:31.631622 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:31.837848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:31.851163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:31.852678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:31.854027 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-62ac47f7-2dfd-4e62-a987-99dd59cd6424 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.239456 Jan 14 09:48:31.865860 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 243/509] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:31 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:32.874128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:32.875927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:32.884935 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:32.885911 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:32.886846 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:32.887539 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:33.051814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:33.062151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:33.064182 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:33.065631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5a5b387b-c706-4cf2-8f05-662ac2be5e04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1808 microversion: 2.20 time: 0.196587 Jan 14 09:48:33.066759 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 267/510] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:32 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:34.087877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:34.089201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:34.098597 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.099062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.099897 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.100355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.237820 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1861783161", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "4455b2ae-129a-4b69-bef7-804a2060c5d4"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:34.272187 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:34.287121 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:34.289364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:34.290661 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d556e1d9-3046-449e-8d3c-31c851efbe4b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1795 microversion: 2.20 time: 0.206648 Jan 14 09:48:34.291824 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 244/511] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:48:34 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1795 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:48:34.326577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] validate_networks() for [('4455b2ae-129a-4b69-bef7-804a2060c5d4', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:48:34.697728 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:34.698803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:34.705603 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.706222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.707337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.707982 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.737071 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:48:34.772005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:48:34.772732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:48:34.773920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:48:34.774054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:48:34.774678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:48:34.785106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.786177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.787042 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.787725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.809644 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Getting quotas for project 36d4eb96fed0490a9a5263574e28cb3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:48:34.816053 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Getting quotas for user 0dccf92db9cd4931837ed36683feab70 and project 36d4eb96fed0490a9a5263574e28cb3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:48:34.824081 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c1c2c63b-e0b8-4489-b4e4-76cbd70cf6d9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 204 len: 0 microversion: 2.1 time: 0.129978 Jan 14 09:48:34.825194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 245/512] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:48:34 2022] DELETE /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:48:34.833311 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:48:34.836633 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:34.837118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:48:34.837739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:34.844981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.845675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.849283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:34.849883 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:34.886290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-93431f40-49c4-4a79-b007-10c7ab722c25 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654858 Jan 14 09:48:34.887143 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 268/513] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:48:34.897460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Action: 'create', calling method: .version_select at 0x7fd321c32310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-231745446"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:34.912719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Getting quotas for project 4768eb3469474c1a8a697727bc0026af. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:48:34.916756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Getting quotas for user 7a6d1bf2310b4ecda782c3d56e51c347 and project 4768eb3469474c1a8a697727bc0026af. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:48:34.934012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [a46258b4-4f73-4ed7-a7d8-c1edfb03f96f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 14 09:48:35.027763 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:35.036029 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-28182b89-3682-451e-8d86-7c701f40f34a tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1508 microversion: 2.1 time: 0.203697 Jan 14 09:48:35.036917 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 246/514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:34 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:35.041430 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7fd77331-5367-461c-8502-beaaee54858e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:35.042047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7fd77331-5367-461c-8502-beaaee54858e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:35.097326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7fd77331-5367-461c-8502-beaaee54858e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:35.104806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7fd77331-5367-461c-8502-beaaee54858e tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1219 microversion: 2.1 time: 0.066839 Jan 14 09:48:35.105337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 247/515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:35 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:35.944225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO oslo.messaging._drivers.impl_rabbit [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [a46258b4-4f73-4ed7-a7d8-c1edfb03f96f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50068. Jan 14 09:48:36.054780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:36.055911 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:36.065413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:36.066396 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:36.067439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:36.068098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:36.272775 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Getting quotas for project 4768eb3469474c1a8a697727bc0026af. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:48:36.276737 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Getting quotas for user 7a6d1bf2310b4ecda782c3d56e51c347 and project 4768eb3469474c1a8a697727bc0026af. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:48:36.290813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b25ac93e-a9e6-4255-b298-f9c14987bf60 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.396703 Jan 14 09:48:36.291395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 269/516] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Jan 14 09:48:34 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:36.298031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:36.299203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:36.304778 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:36.307713 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:36.308486 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:36.309611 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:36.311080 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:36.313536 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7b53a421-2c21-4618-a1d8-2fc062cc6e88 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1508 microversion: 2.1 time: 0.264183 Jan 14 09:48:36.323657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 248/517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:36 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:36.399478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:36.407085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-074ef2d3-5a7a-40ee-b18c-1f76dbe52d07 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1277 microversion: 2.1 time: 0.114637 Jan 14 09:48:36.407679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 270/518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:36 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:36.427660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1758445705", "imageRef": "205a2bdb-5daf-4ff8-8d16-f44f75dcb77a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-231745446", "networks": [{"uuid": "93cbaea9-303f-4b45-a339-18b7a996b616"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:36.486739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] validate_networks() for [('93cbaea9-303f-4b45-a339-18b7a996b616', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:48:37.188645 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:48:37.189171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:48:37.189746 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:48:37.190249 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:48:37.190805 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:48:37.203593 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:37.206558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:37.208525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:37.209188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:37.229466 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Getting quotas for project 4768eb3469474c1a8a697727bc0026af. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:48:37.234890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Getting quotas for user 7a6d1bf2310b4ecda782c3d56e51c347 and project 4768eb3469474c1a8a697727bc0026af. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:48:37.247317 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:48:37.251463 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='205a2bdb-5daf-4ff8-8d16-f44f75dcb77a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:48:37.309363 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-eb163c0e-be53-495d-bd1e-6d03f8171f1d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885266 Jan 14 09:48:37.319399 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 249/519] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:48:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:48:37.329972 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bb00b2b6-6ba4-4248-acb4-6888044ade52 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:37.331297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bb00b2b6-6ba4-4248-acb4-6888044ade52 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:37.335462 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:37.335772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:37.342425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:37.342933 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:37.343975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:37.344630 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:37.408620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bb00b2b6-6ba4-4248-acb4-6888044ade52 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:37.415066 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bb00b2b6-6ba4-4248-acb4-6888044ade52 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1258 microversion: 2.1 time: 0.093168 Jan 14 09:48:37.416161 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 271/520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:37 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:37.428441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:37.429120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:37.436243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:37.436779 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:37.437646 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:37.438151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:37.608591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:37.619154 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f11d5929-7cd4-4087-9388-94ad8ef4b38a tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.194590 Jan 14 09:48:37.619764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 272/521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:37 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:37.690819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:37.704783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-05182362-4c9f-4b9f-adc4-5a09a988f0da tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1508 microversion: 2.1 time: 0.374022 Jan 14 09:48:37.705706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 250/522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:37 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:38.186137 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-1562fde2-6831-46e5-9048-c13da3d48dc3 req-6522c582-2a84-41f0-a10f-5e8bc862010d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e2711b-ed08-421c-b99d-06ef5bd0a404", "tag": "cab54f6b-8055-4590-8745-9afc5fb0f88a"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:38.189328 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:38.189328 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:48:38.198122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-1562fde2-6831-46e5-9048-c13da3d48dc3 req-6522c582-2a84-41f0-a10f-5e8bc862010d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.198633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-1562fde2-6831-46e5-9048-c13da3d48dc3 req-6522c582-2a84-41f0-a10f-5e8bc862010d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.215172 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-1562fde2-6831-46e5-9048-c13da3d48dc3 req-6522c582-2a84-41f0-a10f-5e8bc862010d service nova] Creating event network-changed:cab54f6b-8055-4590-8745-9afc5fb0f88a for instance c4e2711b-ed08-421c-b99d-06ef5bd0a404 on hv-cinder-82160 Jan 14 09:48:38.222120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-1562fde2-6831-46e5-9048-c13da3d48dc3 req-6522c582-2a84-41f0-a10f-5e8bc862010d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041146 Jan 14 09:48:38.223594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 273/523] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:48:38.436494 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:38.437122 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:38.445327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.445772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.446642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.447133 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.559727 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:38.569203 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dc13e600-3aaa-4199-a7c4-3fbb4cda26b5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1310 microversion: 2.1 time: 0.139439 Jan 14 09:48:38.569777 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 251/524] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:38 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1310 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:38.639741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:38.640891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:38.649636 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.650716 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.651683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.652398 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.728762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:38.734706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:38.754553 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.755644 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.759887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:38.760815 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:38.922842 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:38.953413 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c9f2d8e0-030e-42f4-be8d-751fe77a1712 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 200 len: 1466 microversion: 2.1 time: 0.235013 Jan 14 09:48:38.960439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 252/525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:38 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 1466 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:39.021491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:39.035606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9f00ce96-9dfa-4375-a814-b7ba5435bceb tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.402244 Jan 14 09:48:39.037545 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 274/526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:38 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:39.063032 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:39.063632 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:39.072530 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:39.073170 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:39.074639 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:39.075206 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:39.168428 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lazy-loading 'services' on Instance uuid 280d074f-8581-4736-a953-d93b0e2f6c6d {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:48:39.282502 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1994e55f-28d7-4d61-b6ec-703edf825164 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-volume_attachments/3a4a65f6-0fa0-4298-a787-93a97fa14a5f" status: 202 len: 0 microversion: 2.1 time: 0.223820 Jan 14 09:48:39.284773 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 253/527] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:48:39 2022] DELETE /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-volume_attachments/3a4a65f6-0fa0-4298-a787-93a97fa14a5f => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:48:39.590888 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:39.592140 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:39.616637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:39.624089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:39.625968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:39.627084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:39.765227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:39.776326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5971a9ac-cef0-400e-a15a-4ac393ed0cbe tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1316 microversion: 2.1 time: 0.191891 Jan 14 09:48:39.789180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 275/528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:39 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:39.978882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:39.979590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 4cc92076-08d2-4373-b753-89ccf31977b3] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:39.994521 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:39.994986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:39.995796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:39.996518 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.021938 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] HTTP exception thrown: Instance 4cc92076-08d2-4373-b753-89ccf31977b3 could not be found. Jan 14 09:48:40.022685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Returning 404 to user: Instance 4cc92076-08d2-4373-b753-89ccf31977b3 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:48:40.023634 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d7468ead-7c84-4579-b384-032dc6acbbb9 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3" status: 404 len: 111 microversion: 2.1 time: 0.049444 Jan 14 09:48:40.024217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 254/529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:39 2022] GET /compute/v2.1/servers/4cc92076-08d2-4373-b753-89ccf31977b3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:48:40.037214 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:40.038205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:40.051003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.052284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.053034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:40.053657 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:40.055997 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.058093 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.061452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.061909 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.062756 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.063196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.110899 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:48:40.290879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6858ca80-650e-4989-94ac-82261d6b2542 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "DELETE /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 204 len: 0 microversion: 2.1 time: 0.259377 Jan 14 09:48:40.294686 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 276/530] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:48:40 2022] DELETE /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:48:40.303872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-6394e403-35d1-42f6-afd7-675a9a64afe1 req-f0a80f38-7a04-48af-a3b7-0b5348128dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc92076-08d2-4373-b753-89ccf31977b3", "name": "network-vif-deleted", "tag": "5a23db63-64e3-4028-bc26-b6109dcd48ad"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:40.308087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:40.308087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:48:40.324825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-6394e403-35d1-42f6-afd7-675a9a64afe1 req-f0a80f38-7a04-48af-a3b7-0b5348128dee service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.326177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-6394e403-35d1-42f6-afd7-675a9a64afe1 req-f0a80f38-7a04-48af-a3b7-0b5348128dee service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.333225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:40.354554 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aaa5e7f2-afe6-4080-9712-33235dfe46b5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.297204 Jan 14 09:48:40.355907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 255/531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:40 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:40.361284 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:40.365572 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:40.370512 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-6394e403-35d1-42f6-afd7-675a9a64afe1 req-f0a80f38-7a04-48af-a3b7-0b5348128dee service nova] Creating event network-vif-deleted:5a23db63-64e3-4028-bc26-b6109dcd48ad for instance 4cc92076-08d2-4373-b753-89ccf31977b3 on hv-cinder-82160 Jan 14 09:48:40.384723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.385699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.387161 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-6394e403-35d1-42f6-afd7-675a9a64afe1 req-f0a80f38-7a04-48af-a3b7-0b5348128dee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090763 Jan 14 09:48:40.401619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.402418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 277/532] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:40.403416 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.632857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:40.645258 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1f486213-91e2-47c1-bc2d-004862e15964 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.286610 Jan 14 09:48:40.654693 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 256/533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:40 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:40.796479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:40.797815 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:40.803781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.804227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.805017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:40.805453 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:40.965100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:40.974467 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a2ffe153-7b02-4493-a31b-a5ad135ffe02 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.182560 Jan 14 09:48:40.975306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 278/534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:40 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:41.377147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:41.377750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:41.386613 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:41.386810 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:41.387839 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:41.388275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:41.531762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:41.539071 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c0b90264-91f4-48ed-b594-467b8e1c15db tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.165686 Jan 14 09:48:41.546956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 257/535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:41 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:41.664338 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:41.665588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:41.676883 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:41.677695 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:41.678818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:41.679897 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:41.826106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:41.833801 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-021bccab-9680-495c-b4da-a60cd05fac0b tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.173990 Jan 14 09:48:41.834430 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 279/536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:41 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:41.991730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:41.992260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:41.998907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:41.999365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:42.000163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:42.000607 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:42.157884 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:42.165420 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c140feb9-14c1-4f06-82bf-54a898d9575c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.177310 Jan 14 09:48:42.166006 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 258/537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:41 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:42.555761 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:42.556379 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:42.563632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:42.564080 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:42.564870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:42.565308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:42.714831 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:42.723366 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-33157c3f-d9d4-4aad-8266-403737298756 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.171144 Jan 14 09:48:42.724201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 280/538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:42 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:42.851454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:42.852547 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:42.861540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:42.862210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:42.863545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:42.864619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:43.017187 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:43.026682 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-773154eb-c80d-4c4b-9b0a-3ccb3eacde67 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.178809 Jan 14 09:48:43.027276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 259/539] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:42 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:43.188894 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:43.189657 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:43.197291 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:43.197706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:43.198717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:43.199159 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:43.380563 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:43.389659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-525d2ba2-da87-4b50-89fc-b3c6f70e44e1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.205894 Jan 14 09:48:43.390184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 281/540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:43 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:43.741887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:43.742573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:43.748981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:43.749433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:43.750227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:43.750747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:43.907676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:43.915152 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e9ba4306-3adb-43ea-8f18-e5f242e95a70 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.177642 Jan 14 09:48:43.915729 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 260/541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:43 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:44.057251 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:44.058032 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:44.064395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:44.064849 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:44.065641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:44.066083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:44.205704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:44.214343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d9a770f8-1eaa-4ee6-ba44-efa6d139762e tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.161273 Jan 14 09:48:44.215082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 282/542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:44 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:44.407375 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:44.407908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:44.414078 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:44.414580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:44.415383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:44.415825 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:44.563425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:44.571147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3bfa41af-18b7-437b-bfe0-eaf3c7b7f0f8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.168067 Jan 14 09:48:44.571736 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 261/543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:44 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:44.931635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:44.932238 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:44.939086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:44.939564 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:44.940348 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:44.940781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:45.086524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:45.094092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f2556a03-41f8-484c-a171-6cf0bdda42c6 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.165982 Jan 14 09:48:45.094741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 283/544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:44 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:45.233552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:45.234144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:45.240552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:45.241005 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:45.241879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:45.242323 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:45.406154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:45.413412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-08acad82-d895-45df-a071-e474e5e374a8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.183995 Jan 14 09:48:45.413970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 262/545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:45 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:45.590206 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:45.590928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:45.597230 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:45.597740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:45.598511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:45.598952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:45.736084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:45.744166 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3b99d120-4fec-4eb6-8448-1f3d12025e93 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.157687 Jan 14 09:48:45.745120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 284/546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:45 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:46.113431 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:46.114642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:46.120535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:46.121231 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:46.122085 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:46.122616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:46.302628 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:46.310304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dad7686e-62a3-41d7-9443-1d7958b28a23 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.201513 Jan 14 09:48:46.310942 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 263/547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:46 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:46.429948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:46.430884 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:46.438414 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:46.439155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:46.439957 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:46.440482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:46.605697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:46.613743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-92b2e23f-aef8-418d-b05a-0aa010506ba8 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.187758 Jan 14 09:48:46.614306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 285/548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:46 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:46.760761 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:46.761859 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:46.769867 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:46.770201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:46.771179 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:46.771624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:46.929626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:46.937872 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a5504e7e-c7cd-4437-a0e0-019151858151 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.180843 Jan 14 09:48:46.947168 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 264/549] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:46 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:47.328758 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:47.329566 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:47.337817 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:47.338296 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:47.339230 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:47.339667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:47.476943 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:47.485320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-55919c19-e4b8-4220-b7be-9fa3e5f67888 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.160948 Jan 14 09:48:47.485889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 286/550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:47 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:47.631295 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:47.631954 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:47.640869 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:47.641330 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:47.642276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:47.642982 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:47.787848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:47.795754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e0d71fa7-72cb-4c78-8988-86366c55e343 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.168835 Jan 14 09:48:47.796509 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 265/551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:47 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:47.959485 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:47.961944 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:47.974505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:47.975259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:47.976111 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:47.976595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:48.121797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:48.129590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8adfe5ef-3b54-496d-83b9-ec966dc76753 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.178058 Jan 14 09:48:48.138684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 287/552] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:47 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:48.503510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:48.504117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:48.510814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:48.511630 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:48.513440 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:48.514107 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:48.656228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:48.673825 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e6b1b90c-8807-4223-8c48-3acabfc68d16 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.173528 Jan 14 09:48:48.681926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 266/553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:48 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:48.817395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:48.818085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:48.825536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:48.825995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:48.826819 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:48.827259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:48.990516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:48.999336 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-39cd8857-f8dc-44c2-a145-a8f844419393 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.190689 Jan 14 09:48:49.000433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 288/554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:48 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:49.147297 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:49.148731 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:49.156071 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:49.156510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:49.157318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:49.157767 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:49.333101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:49.341643 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d5739909-0b27-4de4-867a-9b7ee6925b53 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.198263 Jan 14 09:48:49.342678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 267/555] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:49 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:49.698336 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:49.699673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:49.708460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:49.709589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:49.710881 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:49.711616 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:49.941894 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:49.956270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8fc726df-f09d-4e41-b683-8b76d9ff9e84 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.261289 Jan 14 09:48:49.957211 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 289/556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:49 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:50.021320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:50.023024 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:50.043322 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:50.044381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:50.045533 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:50.046798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:50.233855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:50.248699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-40ae7635-5b96-4664-804c-d647cf0b3b74 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.235317 Jan 14 09:48:50.249850 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 268/557] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:50 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:50.359933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:50.360917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:50.370928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:50.371751 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:50.373284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:50.374093 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:50.531077 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:50.544313 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2af72b49-f411-44c7-a231-ed137e54509b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.188238 Jan 14 09:48:50.545349 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 290/558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:50 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:50.983696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:50.984545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:50.991585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:50.992130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:50.993012 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:50.993541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:51.158234 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:51.166385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9f4863ec-5b28-4d67-85ce-ad7348234569 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.187294 Jan 14 09:48:51.166970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 269/559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:50 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:51.274755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:51.275281 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:51.282472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:51.282930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:51.283754 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:51.284207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:51.463655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:51.472492 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d07219e0-0448-4b15-b279-29b9fe9694fe tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.201652 Jan 14 09:48:51.473187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 291/560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:51 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:51.570114 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:51.570752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:51.579024 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:51.579696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:51.580692 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:51.581210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:51.725520 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:51.734179 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ae6d07bf-ffbb-4383-ae26-fc5d7af14052 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.167722 Jan 14 09:48:51.734796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 270/561] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:51 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:52.183853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:52.184504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:52.190869 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:52.191326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:52.192123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:52.192571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:52.331099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:52.338529 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8b1fca29-ee50-469b-9d08-fc545bcc8d69 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.158321 Jan 14 09:48:52.339152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 292/562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:52 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:52.498196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:52.499147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:52.507199 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:52.507800 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:52.508720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:52.509268 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:52.759484 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:52.760516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:52.767945 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:52.769280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:52.770773 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:52.771212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:52.811375 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:52.827677 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-cf5141ce-2fea-4f3c-8b8b-745e4129b7a7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.333881 Jan 14 09:48:52.828627 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 271/563] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:52 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:52.953817 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:52.962472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0d7f6b51-66a1-4581-b0d7-a74a59cf3ec3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.209352 Jan 14 09:48:52.963156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 293/564] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:52 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:53.311739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-560e7fe8-29c4-4c4f-a40f-2f45e1cb9898 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:53.325306 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-560e7fe8-29c4-4c4f-a40f-2f45e1cb9898 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.326590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-560e7fe8-29c4-4c4f-a40f-2f45e1cb9898 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.371066 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:53.377433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:53.399750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-560e7fe8-29c4-4c4f-a40f-2f45e1cb9898 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Going to try to stop instance {{(pid=128092) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 14 09:48:53.402524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.403904 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.405377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.417045 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.519847 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-560e7fe8-29c4-4c4f-a40f-2f45e1cb9898 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.215154 Jan 14 09:48:53.521536 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 272/565] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:48:53 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:48:53.549850 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:53.552303 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:53.563890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.564361 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.565454 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.565894 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.648191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:53.656613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3d6c869f-6e04-42d1-ba41-df5261c7aa43 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.300515 Jan 14 09:48:53.657332 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 294/566] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:53 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:53.720084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-13c9a2f8-dc65-4d72-b2d7-cc698681f1f2 req-0d4f3bf3-00d0-476e-b095-f34b6fc825fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:53.722796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:53.722796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:48:53.736574 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-13c9a2f8-dc65-4d72-b2d7-cc698681f1f2 req-0d4f3bf3-00d0-476e-b095-f34b6fc825fb service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.737991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-13c9a2f8-dc65-4d72-b2d7-cc698681f1f2 req-0d4f3bf3-00d0-476e-b095-f34b6fc825fb service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.753783 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-13c9a2f8-dc65-4d72-b2d7-cc698681f1f2 req-0d4f3bf3-00d0-476e-b095-f34b6fc825fb service nova] Creating event network-changed:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:48:53.762990 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-13c9a2f8-dc65-4d72-b2d7-cc698681f1f2 req-0d4f3bf3-00d0-476e-b095-f34b6fc825fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050566 Jan 14 09:48:53.765260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 295/567] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:53.860195 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:53.861141 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:53.868807 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:53.871457 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.872892 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.874116 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.874899 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.885809 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-51b7d507-64f8-4392-aee6-d5c1ba9dc58e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.346574 Jan 14 09:48:53.899877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 273/568] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:53 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:53.987715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:53.988261 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:53.997352 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:53.998209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:53.999694 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:54.000503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:54.085720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:54.102276 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-11cde758-5abb-43d7-95cb-cfa9959aa23f tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.250529 Jan 14 09:48:54.103426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 296/569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:53 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:54.319781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:54.328960 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-67979a10-cdd3-4fa9-9f55-b0ede821132a tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.345216 Jan 14 09:48:54.329556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 274/570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:53 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:54.685831 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:54.687596 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:54.700096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:54.700920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:54.702674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:54.703814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:54.908308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:54.911915 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:54.913019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:54.922057 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-57ff9ffe-3b0d-4071-bb25-d6f189e64e01 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.244180 Jan 14 09:48:54.923685 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 297/571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:54 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:54.924271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:54.925017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:54.926165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:54.927026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:55.130231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:55.132953 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:55.150667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:55.157262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:55.157262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:55.157262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:55.252958 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:55.266208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f32161a5-002d-471b-b317-f6b5b8031840 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.360826 Jan 14 09:48:55.267661 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 275/572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:54 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:55.329320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:55.347020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cd5d036c-b95e-4e3e-bc06-c936cf533400 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.227378 Jan 14 09:48:55.347631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 298/573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:55 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:55.353158 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:55.353781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:55.361129 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:55.361564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:55.362720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:55.362890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:55.519599 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:55.527594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-292d318b-ee9d-4e16-8bcd-33c01572e6b1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.178099 Jan 14 09:48:55.528213 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 276/574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:55 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:55.941964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:55.942729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:55.950338 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:55.950922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:55.951799 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:55.952278 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.109243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:56.117909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8a60de7d-ef7b-44ca-a969-26bc08c795c9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.180054 Jan 14 09:48:56.118542 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 299/575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:55 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:56.291467 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:56.292237 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:56.299904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.300345 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.301153 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.301590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.370940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:56.372755 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:56.384086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.384902 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.386483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.388010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.496968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:56.514210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ba16f91d-f411-44a1-a399-132a39c33fef tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.227928 Jan 14 09:48:56.524381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 277/576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:56 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:56.545744 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:56.546377 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:56.555171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.556524 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.557337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.557779 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.597643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:56.607306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ae349d25-fe2d-4397-b251-63be4221ed44 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.243732 Jan 14 09:48:56.607878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 300/577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:56 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:56.753218 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:56.767862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ea1c4e8b-1805-4c6b-8ab1-555f142d7f01 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.225140 Jan 14 09:48:56.768571 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 278/578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:56 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:56.838746 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-219a8baf-75aa-417f-aa6c-003b64d059bb req-3ef6f167-ce2c-46b5-9803-e9c3f1c19bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e2711b-ed08-421c-b99d-06ef5bd0a404", "name": "network-vif-plugged", "status": "completed", "tag": "cab54f6b-8055-4590-8745-9afc5fb0f88a"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:56.842519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:56.842519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:48:56.855526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-219a8baf-75aa-417f-aa6c-003b64d059bb req-3ef6f167-ce2c-46b5-9803-e9c3f1c19bf1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:56.856313 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-219a8baf-75aa-417f-aa6c-003b64d059bb req-3ef6f167-ce2c-46b5-9803-e9c3f1c19bf1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:56.880327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-219a8baf-75aa-417f-aa6c-003b64d059bb req-3ef6f167-ce2c-46b5-9803-e9c3f1c19bf1 service nova] Creating event network-vif-plugged:cab54f6b-8055-4590-8745-9afc5fb0f88a for instance c4e2711b-ed08-421c-b99d-06ef5bd0a404 on hv-cinder-82160 Jan 14 09:48:56.890623 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-219a8baf-75aa-417f-aa6c-003b64d059bb req-3ef6f167-ce2c-46b5-9803-e9c3f1c19bf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057224 Jan 14 09:48:56.891702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 301/579] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:48:57.142242 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:57.142981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:57.149678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.150196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.151092 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.151696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.308105 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:57.317193 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ab92ef1a-2eb7-4075-9003-4dc9fe0e0e83 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.178706 Jan 14 09:48:57.317821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 279/580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:57 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:57.533382 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:57.534074 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:57.540365 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.540815 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.541607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.542043 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.631914 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:57.632525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:57.639816 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.640262 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.641069 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.641499 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.727129 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:57.740002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-19fe4efa-8809-4013-afe8-1870199561b0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.211159 Jan 14 09:48:57.740967 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 302/581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:57 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:57.794021 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:57.794681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:57.800813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.801270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.802083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:57.802555 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:57.812218 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:57.824119 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2e5eca73-7dc9-4b0d-a32b-2b44797ae917 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.195421 Jan 14 09:48:57.825594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 280/582] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:57 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:57.985684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:57.994460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8b0dc632-7551-4a90-aa4e-d8eb675d674e tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.204530 Jan 14 09:48:57.995078 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 303/583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:57 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:58.336752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:58.337384 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:58.345290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.345743 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:58.346686 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.347132 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:58.548907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:58.563660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dc45c2a8-17ff-466f-9838-c83d2b859f48 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1319 microversion: 2.1 time: 0.230503 Jan 14 09:48:58.565414 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 281/584] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:58 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:58.767941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:58.769151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:58.778448 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.779236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:58.780157 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.780847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:58.851214 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:58.852303 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:58.860826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.861553 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:58.862909 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.863581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:58.948979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:58.958502 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-51a67caa-9266-4f7e-b0e7-15513d6f384f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.195357 Jan 14 09:48:58.959308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 304/585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:58 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:58.974828 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-0494f04f-b07e-4e6b-9a34-9972d33bce3f req-830cc6a6-9ce0-4ccb-89f1-c31ad82c9162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "name": "network-vif-plugged", "status": "completed", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:58.980292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:58.980292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:48:58.988610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-0494f04f-b07e-4e6b-9a34-9972d33bce3f req-830cc6a6-9ce0-4ccb-89f1-c31ad82c9162 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:58.989452 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-0494f04f-b07e-4e6b-9a34-9972d33bce3f req-830cc6a6-9ce0-4ccb-89f1-c31ad82c9162 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.005414 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-0494f04f-b07e-4e6b-9a34-9972d33bce3f req-830cc6a6-9ce0-4ccb-89f1-c31ad82c9162 service nova] Creating event network-vif-plugged:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:48:59.015716 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-0494f04f-b07e-4e6b-9a34-9972d33bce3f req-830cc6a6-9ce0-4ccb-89f1-c31ad82c9162 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053612 Jan 14 09:48:59.016817 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 305/586] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:59.028662 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:59.029919 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:59.045589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.046423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.048148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.049823 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.175982 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:59.190848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c5e9198e-6dd5-4edc-991e-7ca7e5e6e856 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1521 microversion: 2.1 time: 0.345585 Jan 14 09:48:59.192772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 282/587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:58 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:59.281717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:59.291055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-24ecd769-c8f5-41c3-a66d-9bc834b4ac47 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.272409 Jan 14 09:48:59.291950 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 306/588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:59 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:48:59.594383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:59.597178 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:59.618150 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.619048 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.620527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.622821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.654255 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-286d631f-c0fe-456d-a56f-67dc4c595ad0 req-2f425eae-b7ec-4b04-b87a-fd871bf36fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468932bd-d6e7-43a5-84f1-53cc479aa7b0", "name": "network-vif-deleted", "tag": "fec053d0-2d6f-4bb9-a828-7e99bac5a9b7"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:59.655963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:48:59.655963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:48:59.667572 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-286d631f-c0fe-456d-a56f-67dc4c595ad0 req-2f425eae-b7ec-4b04-b87a-fd871bf36fd5 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.668016 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-286d631f-c0fe-456d-a56f-67dc4c595ad0 req-2f425eae-b7ec-4b04-b87a-fd871bf36fd5 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.680778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-286d631f-c0fe-456d-a56f-67dc4c595ad0 req-2f425eae-b7ec-4b04-b87a-fd871bf36fd5 service nova] Creating event network-vif-deleted:fec053d0-2d6f-4bb9-a828-7e99bac5a9b7 for instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 on hv-cinder-82160 Jan 14 09:48:59.687513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-286d631f-c0fe-456d-a56f-67dc4c595ad0 req-2f425eae-b7ec-4b04-b87a-fd871bf36fd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Jan 14 09:48:59.688590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 307/589] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:48:59.805144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:48:59.814164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4f26c366-cb86-4a46-9ef8-fdef521bfdec tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1508 microversion: 2.1 time: 0.227010 Jan 14 09:48:59.814917 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 283/590] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:59 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:48:59.836677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a135843-0d06-413b-bf00-888abf8339f8", "device": "/dev/sdb"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:48:59.838068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:59.845150 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.845607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.846411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.846847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.982996 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:48:59.983649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:48:59.990407 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.990863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:48:59.991674 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:48:59.992102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:00.166288 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-30580a66-8c5c-4112-b726-52319ce4a6a3 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "POST /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335361 Jan 14 09:49:00.167650 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 308/591] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:48:59 2022] POST /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:49:00.188716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:00.202977 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-645f6046-1b9b-4f3e-ac8f-8c31ad5bd551 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.223999 Jan 14 09:49:00.203994 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 284/592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:48:59 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:00.212465 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:00.213493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:00.220818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:00.221592 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:00.222748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:00.223421 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:00.262898 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:00.263354 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:00.263814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lazy-loading 'fault' on Instance uuid 468932bd-d6e7-43a5-84f1-53cc479aa7b0 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:49:00.317172 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:00.317684 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:00.327765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d153ca82cde4b9d9bac9eb7d33793ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8097afd74a4ab39619485b26bdf483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:00.331850 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:00.332296 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:00.333128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:00.333575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:00.341350 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-42d4974e-20b7-4bf6-b4a4-535853e1e1b7 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 200 len: 1311 microversion: 2.1 time: 0.134264 Jan 14 09:49:00.346697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 309/593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:00 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:00.548505 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:00.564093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1e69bf6d-3c3e-46c0-addd-179968a60816 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1358 microversion: 2.1 time: 0.250396 Jan 14 09:49:00.565064 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 285/594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:00 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:01.230371 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:01.231685 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:01.240284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.240734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.241582 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.242014 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.369818 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:01.371844 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] [instance: 468932bd-d6e7-43a5-84f1-53cc479aa7b0] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:01.382693 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.383525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.384931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.385739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.408495 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] HTTP exception thrown: Instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 could not be found. Jan 14 09:49:01.409331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] Returning 404 to user: Instance 468932bd-d6e7-43a5-84f1-53cc479aa7b0 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:49:01.410528 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a7c577bb-d6ae-473d-bc9d-99dcf895c701 tempest-ServerRescueNegativeTestJSON-1055318597 tempest-ServerRescueNegativeTestJSON-1055318597-project] 10.222.0.48 "GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0" status: 404 len: 111 microversion: 2.1 time: 0.045240 Jan 14 09:49:01.411464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 286/595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:01 2022] GET /compute/v2.1/servers/468932bd-d6e7-43a5-84f1-53cc479aa7b0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:49:01.417048 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:01.430251 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3d60beb3-1018-4e75-a833-d824df0abbb6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.203649 Jan 14 09:49:01.431089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 310/596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:01 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:01.590998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:01.591532 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:01.597916 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.598375 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.599192 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.599630 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.776968 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:01.793178 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2e08851a-61c4-4003-bdae-6a8926a50cd6 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1548 microversion: 2.1 time: 0.207117 Jan 14 09:49:01.794209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 287/597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:01 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1548 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:01.815820 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:01.817036 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:01.826084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.826747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:01.827667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:01.828185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.083671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:02.091746 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6d1368af-d184-4865-8600-c8031f13e023 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1548 microversion: 2.1 time: 0.283839 Jan 14 09:49:02.092521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 311/598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:01 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1548 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:02.111408 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:02.115222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:02.115222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:49:02.116565 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:02.117330 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Searching by: {'deleted': False, 'project_id': '4768eb3469474c1a8a697727bc0026af'} {{(pid=128092) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 14 09:49:02.125091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:02.125540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.126388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:02.126870 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.231821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.multi_cell_list [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128092) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 14 09:49:02.338212 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ee906c1d-70a6-43ef-90d8-acec491a2047 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.233005 Jan 14 09:49:02.339169 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 288/599] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Jan 14 09:49:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:49:02.348892 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:02.350118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:02.357482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:02.357939 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.358772 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:02.359381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.448127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:02.448754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:02.455480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:02.455924 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.456723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:02.457316 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:02.607619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:02.614713 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7bdfacd7-4d40-4b9e-ad79-77907fd9f096 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.170063 Jan 14 09:49:02.615160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 289/600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:02 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:02.644132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:02.651860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b532940b-0265-4866-94f5-2389927635bc tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1548 microversion: 2.1 time: 0.306633 Jan 14 09:49:02.653071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 312/601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:02 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1548 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:03.636535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:03.637680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:03.644453 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:03.644898 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:03.645734 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:03.646169 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:03.802196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:03.810715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c7eec7e6-bf02-4634-9b89-1d2b0986bfeb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1678 microversion: 2.1 time: 0.181998 Jan 14 09:49:03.811202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 290/602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:03 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:04.260079 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cf5b518-02c7-4d19-b691-5b4d250167f9"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:04.261381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:04.268326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:04.268775 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:04.274950 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:04.275738 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:04.571749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-eaf2b4c7-1f37-4d73-bd9f-0234ed479aa0 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315155 Jan 14 09:49:04.573046 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 313/603] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:49:04 2022] POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:49:04.827895 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:04.828736 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:04.835297 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:04.835852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:04.836729 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:04.837237 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:04.988879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:04.997735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d84841de-9680-4327-a342-3dca99346989 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1655 microversion: 2.1 time: 0.174183 Jan 14 09:49:04.998331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 291/604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:04 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:05.017552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6e8aaeee-2bc3-47cd-bab7-53c2fc6c5090 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:05.030473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6e8aaeee-2bc3-47cd-bab7-53c2fc6c5090 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:05.031418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6e8aaeee-2bc3-47cd-bab7-53c2fc6c5090 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:05.153504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6e8aaeee-2bc3-47cd-bab7-53c2fc6c5090 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Going to try to start instance {{(pid=128091) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 14 09:49:05.228815 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6e8aaeee-2bc3-47cd-bab7-53c2fc6c5090 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.217170 Jan 14 09:49:05.229905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 314/605] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:49:05 2022] POST /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:49:05.238685 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:05.239474 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:05.249671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:05.250210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:05.251117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:05.251568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:05.540502 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:05.549740 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bf54505a-5a4f-4cfb-8d04-d8bb4eab7d9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1664 microversion: 2.1 time: 0.314835 Jan 14 09:49:05.561082 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 292/606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:05 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1664 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:06.569145 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:06.570819 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:06.586709 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:06.587878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:06.591376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:06.592330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:06.898160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:06.911136 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bde978dc-d435-46f4-ae3a-0c307818852b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1664 microversion: 2.1 time: 0.346215 Jan 14 09:49:06.911968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 315/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:06 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1664 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:07.932226 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:07.932981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:07.940376 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:07.940818 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:07.941614 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:07.942048 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:08.136364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:08.145025 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-936c1996-9425-4442-b9a9-3c329e2c1ce1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1668 microversion: 2.1 time: 0.216721 Jan 14 09:49:08.145605 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 293/608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:07 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:15.622470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:15.623055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:15.631648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:15.632016 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:15.632837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:15.633289 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:15.668923 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b1e2252e-3744-4947-8cc4-07f8db6941fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments/d787d947-9baf-41f6-b94a-0da3106bdf71" status: 200 len: 194 microversion: 2.20 time: 0.052233 Jan 14 09:49:15.669737 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 316/609] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Jan 14 09:49:15 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments/d787d947-9baf-41f6-b94a-0da3106bdf71 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:49:15.738128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:15.739513 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:15.745768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:15.746276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:15.747183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:15.747587 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:15.833937 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lazy-loading 'services' on Instance uuid a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:49:15.910762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c902bbeb-a459-41d5-ab34-76734f1612f1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments/d787d947-9baf-41f6-b94a-0da3106bdf71" status: 202 len: 0 microversion: 2.20 time: 0.176339 Jan 14 09:49:15.911551 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 294/610] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jan 14 09:49:15 2022] DELETE /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments/d787d947-9baf-41f6-b94a-0da3106bdf71 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:49:15.924633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:15.926432 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:15.938118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:15.939243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:15.940757 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:15.941282 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:15.995147 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b80860ba-4913-488a-9fcc-859de0d3faef tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078209 Jan 14 09:49:15.995898 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 317/611] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jan 14 09:49:15 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:49:16.576019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:16.576801 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:16.583941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:16.584394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:16.585196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:16.585837 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:16.745904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:16.755119 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fe9e210e-9987-4f9a-9915-33f1030c7d73 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1594 microversion: 2.1 time: 0.183583 Jan 14 09:49:16.755718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 295/612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:16 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1594 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:17.009530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:17.011197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:17.018008 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:17.018500 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:17.019301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:17.019740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:17.054323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-263ba567-c810-462e-af28-ee510037c53f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048527 Jan 14 09:49:17.055311 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 318/613] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jan 14 09:49:17 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:49:18.068471 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:18.076114 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:18.084095 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:18.084566 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:18.085422 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:18.085900 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:18.121697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7866f394-d999-4662-b6ca-6c66a60f5af8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057809 Jan 14 09:49:18.121697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 296/614] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jan 14 09:49:18 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:49:19.120915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-e6973cf5-db54-42d7-b256-a53d607f7c7a req-4258d469-833c-4241-9a52-55a83af5b32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:19.123181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:19.123181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:49:19.134997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:19.139040 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:19.147515 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:19.151071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-e6973cf5-db54-42d7-b256-a53d607f7c7a req-4258d469-833c-4241-9a52-55a83af5b32f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:19.152152 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:19.152727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-e6973cf5-db54-42d7-b256-a53d607f7c7a req-4258d469-833c-4241-9a52-55a83af5b32f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:19.154202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:19.155025 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:19.179912 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-e6973cf5-db54-42d7-b256-a53d607f7c7a req-4258d469-833c-4241-9a52-55a83af5b32f service nova] Creating event network-changed:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:49:19.195236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-e6973cf5-db54-42d7-b256-a53d607f7c7a req-4258d469-833c-4241-9a52-55a83af5b32f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079918 Jan 14 09:49:19.196323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 319/615] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:49:19.221814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-19e8eea3-97ef-44b7-a44f-58a95951ee03 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091123 Jan 14 09:49:19.223171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 297/616] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jan 14 09:49:19 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:49:20.249499 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:20.251590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:20.269652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:20.270621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:20.272133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:20.274014 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:20.383382 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-57f53d7a-4c08-4ffc-8f52-417a4a19b0f7 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.146830 Jan 14 09:49:20.390540 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 320/617] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jan 14 09:49:20 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:20.475843 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:20.476561 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:20.484127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:20.484572 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:20.485630 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:20.486200 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:20.521140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:49:20.675831 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a138858b-45f6-4527-8810-6cc2cabcc1a9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 204 len: 0 microversion: 2.20 time: 0.202144 Jan 14 09:49:20.677716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 298/618] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jan 14 09:49:20 2022] DELETE /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 14 09:49:20.691058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:20.692129 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:20.704244 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:20.704714 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:20.706271 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:20.706802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:20.919493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:20.944567 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:20.947124 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:20.949150 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cfacc458-49b6-4b82-be38-45a369b02cc6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.263565 Jan 14 09:49:20.949786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 321/619] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:20 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:49:21.323665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1511962193"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:21.324368 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:21.331090 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.331542 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:21.332332 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.332769 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:21.464984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.network.security_group_api [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Adding security group 5c3cb225-69b9-491a-9fe7-2f319b407d26 to port a8c563c3-b40e-4151-8a9f-8712800674f9 Jan 14 09:49:21.818259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ae32fbe4-f1c6-4e6d-92ce-37218cbd6527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/action" status: 202 len: 0 microversion: 2.1 time: 0.498829 Jan 14 09:49:21.819669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 299/620] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:49:21 2022] POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:49:21.830200 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-b4b10daf-7849-42b7-930b-fd1332c851f5 req-34e58bff-2b6c-488a-b105-2c3679005b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:21.832621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:21.832621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:49:21.845802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:21.846502 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:21.849116 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-b4b10daf-7849-42b7-930b-fd1332c851f5 req-34e58bff-2b6c-488a-b105-2c3679005b70 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.849610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-b4b10daf-7849-42b7-930b-fd1332c851f5 req-34e58bff-2b6c-488a-b105-2c3679005b70 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:21.863119 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.863656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:21.866224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.866992 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:21.876519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-b4b10daf-7849-42b7-930b-fd1332c851f5 req-34e58bff-2b6c-488a-b105-2c3679005b70 service nova] Creating event network-changed:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:49:21.883477 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-b4b10daf-7849-42b7-930b-fd1332c851f5 req-34e58bff-2b6c-488a-b105-2c3679005b70 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057521 Jan 14 09:49:21.884386 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 322/621] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:49:21.984200 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:21.984856 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:21.991979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.992756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:21.993591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:21.994030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:22.064271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:22.075726 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-092f39f6-7ed1-4d8d-ade2-6c8b5fce144c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1760 microversion: 2.1 time: 0.239574 Jan 14 09:49:22.076350 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 300/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:21 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1760 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:22.150869 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:22.159288 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:22.160784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:22.161962 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-93904bf0-9959-4ec1-be04-8a870376d5c5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.184266 Jan 14 09:49:22.162565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 323/623] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:21 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:49:23.181622 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:23.182326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:23.189736 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:23.190186 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:23.193303 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:23.193303 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:23.336368 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:23.344688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:23.346185 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:23.347394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1867b819-3b75-4a32-9c3e-e7b762c2e1fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.170098 Jan 14 09:49:23.347956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 301/624] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:23 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:24.374807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:24.377789 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:24.401275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:24.404291 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:24.405806 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:24.406866 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:24.607098 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:24.615478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:24.617086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:24.618572 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9452763e-e8fe-4874-bc27-ce2524dc694d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1723 microversion: 2.20 time: 0.255877 Jan 14 09:49:24.619237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 324/625] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:24 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:25.259101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:25.259683 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:25.266237 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:25.266752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:25.267558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:25.267999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:25.353340 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lazy-loading 'services' on Instance uuid c4e2711b-ed08-421c-b99d-06ef5bd0a404 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:49:25.430900 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-57ef9d33-cf7c-48a5-8346-a382fda94435 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404/os-volume_attachments/7a135843-0d06-413b-bf00-888abf8339f8" status: 202 len: 0 microversion: 2.1 time: 0.174859 Jan 14 09:49:25.435356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 302/626] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:49:25 2022] DELETE /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404/os-volume_attachments/7a135843-0d06-413b-bf00-888abf8339f8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:49:25.638024 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:25.638657 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:25.645212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:25.645752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:25.646542 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:25.646979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:25.716259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:25.729486 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:25.733687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:25.736150 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-30b86d5d-1fb1-4516-b775-b9ec6443a5f5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 200 len: 1655 microversion: 2.20 time: 0.102224 Jan 14 09:49:25.747656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 325/627] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:25 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:49:26.102677 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-ef7d3114-3ca1-4e81-8656-3ff14b62ceb8 req-7920b593-d276-40ca-a28c-1b1ce1a92ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a", "name": "network-vif-deleted", "tag": "7199b4e9-feda-4595-83c7-1a3f330de646"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:26.104552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:26.104552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:49:26.120888 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-ef7d3114-3ca1-4e81-8656-3ff14b62ceb8 req-7920b593-d276-40ca-a28c-1b1ce1a92ed1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.121452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-ef7d3114-3ca1-4e81-8656-3ff14b62ceb8 req-7920b593-d276-40ca-a28c-1b1ce1a92ed1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.142589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-ef7d3114-3ca1-4e81-8656-3ff14b62ceb8 req-7920b593-d276-40ca-a28c-1b1ce1a92ed1 service nova] Creating event network-vif-deleted:7199b4e9-feda-4595-83c7-1a3f330de646 for instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a on hv-cinder-82160 Jan 14 09:49:26.151553 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-ef7d3114-3ca1-4e81-8656-3ff14b62ceb8 req-7920b593-d276-40ca-a28c-1b1ce1a92ed1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052997 Jan 14 09:49:26.152227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 303/628] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:49:26.596094 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:26.596720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:26.606491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.607840 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.611095 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.611460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.660767 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:49:26.755892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:26.756573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:26.763988 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.764907 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-175902ea-ee1b-41df-b9b6-2dbda8af3650 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 204 len: 0 microversion: 2.1 time: 0.173166 Jan 14 09:49:26.765412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.765548 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 326/629] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:49:26 2022] DELETE /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:49:26.766620 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.767760 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.779602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:26.780286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:26.783329 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] HTTP exception thrown: Instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a could not be found. Jan 14 09:49:26.783924 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Returning 404 to user: Instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:49:26.785042 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5763712b-6773-4c0a-b344-b7479e630176 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 404 len: 111 microversion: 2.20 time: 0.034139 Jan 14 09:49:26.786301 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 304/630] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:26 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:49:26.788747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.789207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.791168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:26.791620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:26.795895 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-073df41e-a5af-4d58-aaa7-e460a6ace1c3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '.version_select at 0x7fd322c4db80>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:26.839239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-073df41e-a5af-4d58-aaa7-e460a6ace1c3 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607580148" status: 204 len: 0 microversion: 2.20 time: 0.047689 Jan 14 09:49:26.840256 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 305/631] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jan 14 09:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607580148 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 14 09:49:27.029020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:27.065224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3c87499e-0c46-49c9-b6e4-472fb71045d5 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1514 microversion: 2.1 time: 0.294558 Jan 14 09:49:27.081003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 327/632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:26 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:27.983043 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-61252b2b-12a9-463a-87fa-10b29dcf1852 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'create', calling method: .version_select at 0x7fd3229a8940>, body: {"keypair": {"name": "tempest-keypair-81716715"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:28.004143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-61252b2b-12a9-463a-87fa-10b29dcf1852 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:49:28.008109 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-61252b2b-12a9-463a-87fa-10b29dcf1852 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for user 4d5195514db043518c76df657c40baa6 and project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:49:28.086185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:28.087583 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:28.096248 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:28.096815 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:28.098029 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:28.098504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:28.232888 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-61252b2b-12a9-463a-87fa-10b29dcf1852 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:49:28.237085 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-61252b2b-12a9-463a-87fa-10b29dcf1852 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for user 4d5195514db043518c76df657c40baa6 and project d87879779a7049fa888526ce5a0bf552. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:49:28.250941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-61252b2b-12a9-463a-87fa-10b29dcf1852 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.272066 Jan 14 09:49:28.251504 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 306/633] 10.222.0.48 () {62 vars in 1198 bytes} [Fri Jan 14 09:49:27 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 273 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 14 09:49:28.270123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:28.279988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c403dbc6-e966-496c-bcb5-28e784cd2093 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1514 microversion: 2.1 time: 0.197289 Jan 14 09:49:28.280581 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 328/634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:28 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:29.302127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:29.303241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:29.312819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:29.313595 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:29.314449 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:29.315009 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:29.531845 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:29.540956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-69073923-fd35-435e-a681-99cd055331b1 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1514 microversion: 2.1 time: 0.246107 Jan 14 09:49:29.542084 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 307/635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:29 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:29.837455 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1012757345", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4533a7b-1d3c-49a1-9516-8877ba93fca2"}], "security_groups": [{"name": "tempest-securitygroup--268589884"}], "key_name": "tempest-keypair-81716715", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:29.974397 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] validate_networks() for [('e4533a7b-1d3c-49a1-9516-8877ba93fca2', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:49:30.420055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:49:30.420483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:49:30.421439 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:49:30.421899 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:49:30.422319 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:49:30.432715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:30.433155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:30.434464 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:30.434913 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:30.465667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for project d87879779a7049fa888526ce5a0bf552. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:49:30.470024 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Getting quotas for user 4d5195514db043518c76df657c40baa6 and project d87879779a7049fa888526ce5a0bf552. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:49:30.490002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:49:30.494434 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-4b80c85b-d0fd-4cd2-8476-ea5fd3e96998 req-263dfc6d-87d5-420b-9a1c-b872869c071d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e2711b-ed08-421c-b99d-06ef5bd0a404", "name": "network-vif-deleted", "tag": "cab54f6b-8055-4590-8745-9afc5fb0f88a"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:30.495603 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:49:30.496133 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:30.496133 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:49:30.504565 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-4b80c85b-d0fd-4cd2-8476-ea5fd3e96998 req-263dfc6d-87d5-420b-9a1c-b872869c071d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:30.505069 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-4b80c85b-d0fd-4cd2-8476-ea5fd3e96998 req-263dfc6d-87d5-420b-9a1c-b872869c071d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:30.517885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-4b80c85b-d0fd-4cd2-8476-ea5fd3e96998 req-263dfc6d-87d5-420b-9a1c-b872869c071d service nova] Creating event network-vif-deleted:cab54f6b-8055-4590-8745-9afc5fb0f88a for instance c4e2711b-ed08-421c-b99d-06ef5bd0a404 on hv-cinder-82160 Jan 14 09:49:30.523549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-4b80c85b-d0fd-4cd2-8476-ea5fd3e96998 req-263dfc6d-87d5-420b-9a1c-b872869c071d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 Jan 14 09:49:30.524489 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 308/636] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:49:30.561526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-65ca1b11-9aea-4609-a9af-978c536a8c07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.726227 Jan 14 09:49:30.563460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 329/637] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jan 14 09:49:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 14 09:49:30.570799 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:30.572350 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:30.579030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b6f017fd-1b9d-4ea7-b5c3-21f71cc8c717 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:30.580270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b6f017fd-1b9d-4ea7-b5c3-21f71cc8c717 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:30.591316 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:30.591851 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:30.592722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:30.593236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:30.660542 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b6f017fd-1b9d-4ea7-b5c3-21f71cc8c717 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:30.668677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b6f017fd-1b9d-4ea7-b5c3-21f71cc8c717 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:30.671975 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dccf92db9cd4931837ed36683feab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d4eb96fed0490a9a5263574e28cb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:30.675380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b6f017fd-1b9d-4ea7-b5c3-21f71cc8c717 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:30.676533 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b6f017fd-1b9d-4ea7-b5c3-21f71cc8c717 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1280 microversion: 2.20 time: 0.105198 Jan 14 09:49:30.677096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 330/638] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:30 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:30.683710 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-75dc1f99-8303-403b-a2e9-5576a752d4e9 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 200 len: 1304 microversion: 2.1 time: 0.119974 Jan 14 09:49:30.684675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 309/639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:30 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:31.700019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:31.702218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:31.702717 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:31.703818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] [instance: c4e2711b-ed08-421c-b99d-06ef5bd0a404] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:31.711458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:31.711915 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:31.712331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:31.712758 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:31.713230 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:31.713355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:31.714625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:31.715292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:31.733661 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] HTTP exception thrown: Instance c4e2711b-ed08-421c-b99d-06ef5bd0a404 could not be found. Jan 14 09:49:31.734633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] Returning 404 to user: Instance c4e2711b-ed08-421c-b99d-06ef5bd0a404 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:49:31.735725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7f43441b-e580-47da-b841-4d09e776ed10 tempest-VolumesSnapshotTestJSON-1667758872 tempest-VolumesSnapshotTestJSON-1667758872-project] 10.222.0.48 "GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404" status: 404 len: 111 microversion: 2.1 time: 0.039096 Jan 14 09:49:31.736745 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 331/640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:31 2022] GET /compute/v2.1/servers/c4e2711b-ed08-421c-b99d-06ef5bd0a404 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:49:31.814148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:31.822930 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:31.824487 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:31.825626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-eec59edb-594e-4b75-8573-a9c06ac06a98 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1350 microversion: 2.20 time: 0.129393 Jan 14 09:49:31.826568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 310/641] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:31 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:32.847308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:32.847308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:32.853415 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:32.853867 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:32.855371 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:32.855824 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:33.022802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:33.032627 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:33.034655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:33.036034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-493a7de6-0eb4-417d-9ed4-23fc72604d65 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.195350 Jan 14 09:49:33.036917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 332/642] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:32 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:33.253669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-3b5fe4d2-2b6b-4d3e-a064-5a7476c1b1fb req-e9c3f4f7-6585-4cf7-a7e0-aa204f5b3711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:33.275125 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:33.275125 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:49:33.291588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-3b5fe4d2-2b6b-4d3e-a064-5a7476c1b1fb req-e9c3f4f7-6585-4cf7-a7e0-aa204f5b3711 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:33.292893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-3b5fe4d2-2b6b-4d3e-a064-5a7476c1b1fb req-e9c3f4f7-6585-4cf7-a7e0-aa204f5b3711 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:33.304757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-3b5fe4d2-2b6b-4d3e-a064-5a7476c1b1fb req-e9c3f4f7-6585-4cf7-a7e0-aa204f5b3711 service nova] Creating event network-changed:f484129e-42b3-4eed-8bf4-b44de5367943 for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 on hv-cinder-82160 Jan 14 09:49:33.311057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-3b5fe4d2-2b6b-4d3e-a064-5a7476c1b1fb req-e9c3f4f7-6585-4cf7-a7e0-aa204f5b3711 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075253 Jan 14 09:49:33.311877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 311/643] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:49:34.055081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:34.055882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:34.062327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:34.062808 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:34.063739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:34.064270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:34.207429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:34.218714 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:34.220183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:34.221284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-518a482e-13a8-4ddf-921a-e2cdd518409b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.170343 Jan 14 09:49:34.221851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 333/644] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:34 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:35.241048 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:35.241772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:35.248700 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:35.249148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:35.249935 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:35.250402 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:35.422219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:35.432463 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:35.434289 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:35.435496 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0d6a8862-49e1-47ea-a251-b75e07f131aa tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.199087 Jan 14 09:49:35.436235 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 312/645] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:35 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:36.455025 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:36.455659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:36.461900 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:36.462370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:36.463175 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:36.464107 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:36.625890 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:36.634415 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:36.636581 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:36.637843 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3d8d3aea-0119-4b50-b6bb-0cdaad008349 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.186402 Jan 14 09:49:36.638430 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 334/646] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:36 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:37.658261 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:37.658899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:37.664970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:37.665416 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:37.666219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:37.667239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:37.800889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:37.809503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:37.811091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:37.812220 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-613ab774-2eaa-441f-97f5-fabc6c4e6190 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.157654 Jan 14 09:49:37.812780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 313/647] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:37 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:38.830036 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:38.830735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:38.837047 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:38.837555 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:38.839734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:38.839734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:38.974032 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:38.983389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:38.984873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:38.986078 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6abfa166-8d82-4a3e-9251-2c277892c9de tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.159713 Jan 14 09:49:38.987129 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 335/648] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:38 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:40.006231 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:40.006861 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:40.014052 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:40.014531 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:40.015318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:40.015998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:40.153054 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:40.161476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:40.163013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:40.164135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-524c7bcd-9608-4982-9a51-c16b2439dd19 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.161626 Jan 14 09:49:40.164705 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 314/649] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:40 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:41.182787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:41.184063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:41.190487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:41.190936 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:41.191708 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:41.192145 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:41.335544 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:41.343700 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:41.345325 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:41.346782 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7f0fe287-9d60-4219-b4f2-d6b365efebe8 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.168348 Jan 14 09:49:41.347344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 336/650] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:41 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:42.364899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:42.365501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:42.372112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:42.372556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:42.373345 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:42.373777 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:42.508792 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:42.516604 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:42.518093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:42.519228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f38b351b-d150-4405-8844-a5945b306565 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.158051 Jan 14 09:49:42.519777 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 315/651] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:42 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:43.543333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:43.543933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:43.550151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:43.550631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:43.551403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:43.551831 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:43.678549 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:43.687191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:43.688684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:43.689781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-18c05520-c5cb-4cd2-9798-461355853b30 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.150651 Jan 14 09:49:43.690337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 337/652] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:43 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:44.707755 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:44.709164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:44.715717 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:44.716170 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:44.716965 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:44.717405 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:44.845121 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:44.852807 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:44.854416 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:44.855511 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e05cbdd8-b791-4618-844c-e29d1590ba7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.152086 Jan 14 09:49:44.856061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 316/653] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:44 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:49:45.856342 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-89488c6a-39e3-411f-b711-934ce8425a00 req-c1682dad-ac8f-4c5c-be73-06773ac75ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "name": "network-vif-plugged", "status": "completed", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:45.858720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:45.858720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:49:45.866810 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-89488c6a-39e3-411f-b711-934ce8425a00 req-c1682dad-ac8f-4c5c-be73-06773ac75ce4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:45.867345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-89488c6a-39e3-411f-b711-934ce8425a00 req-c1682dad-ac8f-4c5c-be73-06773ac75ce4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:45.873679 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:45.875585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:45.881972 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-89488c6a-39e3-411f-b711-934ce8425a00 req-c1682dad-ac8f-4c5c-be73-06773ac75ce4 service nova] Creating event network-vif-plugged:f484129e-42b3-4eed-8bf4-b44de5367943 for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 on hv-cinder-82160 Jan 14 09:49:45.883853 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:45.884496 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:45.886435 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:45.887513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-89488c6a-39e3-411f-b711-934ce8425a00 req-c1682dad-ac8f-4c5c-be73-06773ac75ce4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035165 Jan 14 09:49:45.887691 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:45.888519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 338/654] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:49:46.071719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:46.080196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:46.081846 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:46.082844 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-82672d92-c373-4ee4-9c8f-a88d27eaabc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.213660 Jan 14 09:49:46.083406 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 317/655] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:45 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:49:47.101914 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:47.102569 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:47.109411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:47.109858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:47.110673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:47.111114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:47.250797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:47.258901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:47.260974 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:47.262119 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2b451435-df1f-4fd4-b422-395a79caaa67 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.164776 Jan 14 09:49:47.262891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 339/656] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:47 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:48.280764 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:48.281374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:48.287766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:48.288220 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:48.289007 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:48.289441 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:48.420940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:48.428650 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:48.430130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:48.431235 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6c79fcb6-8fb0-44de-a547-8e8ba345345c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.154193 Jan 14 09:49:48.432279 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 318/657] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:48 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:49:49.449650 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:49.450264 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:49.456789 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:49.457237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:49.458016 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:49.458475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:49.591313 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:49.599384 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:49.600867 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:49.601956 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cb54826f-4012-4e7c-b69c-84bf670e42e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1405 microversion: 2.20 time: 0.156744 Jan 14 09:49:49.602543 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 340/658] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:49 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:50.620151 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:50.621131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:50.627653 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:50.628097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:50.628872 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:50.629304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:50.758456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:50.767151 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:50.768633 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:50.769864 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1e914c5b-2124-4628-a488-5cfe0e3aeeb4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1597 microversion: 2.20 time: 0.154015 Jan 14 09:49:50.770654 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 319/659] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:49:50 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:49:50.787922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:50.788495 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:50.803407 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:50.803853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:50.804638 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:50.805064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:50.889831 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ee54e7c0-7c29-4245-812e-c38f6f4d2bbe tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106368 Jan 14 09:49:50.890480 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 341/660] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jan 14 09:49:50 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:49:52.203892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:52.204891 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:52.208990 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-4b6a4e1a-7f12-4f0b-bb4b-506ff11f697f req-b38db532-930f-4637-99fa-1477d069497f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:52.211403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:49:52.211403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:49:52.212188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:52.213188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:52.213993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:52.214459 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:52.229373 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-4b6a4e1a-7f12-4f0b-bb4b-506ff11f697f req-b38db532-930f-4637-99fa-1477d069497f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:52.233952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-4b6a4e1a-7f12-4f0b-bb4b-506ff11f697f req-b38db532-930f-4637-99fa-1477d069497f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:52.269192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-4b6a4e1a-7f12-4f0b-bb4b-506ff11f697f req-b38db532-930f-4637-99fa-1477d069497f service nova] Creating event network-changed:f484129e-42b3-4eed-8bf4-b44de5367943 for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 on hv-cinder-82160 Jan 14 09:49:52.276845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-4b6a4e1a-7f12-4f0b-bb4b-506ff11f697f req-b38db532-930f-4637-99fa-1477d069497f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072141 Jan 14 09:49:52.277941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 342/661] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:49:52.309356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-70321cdd-397c-4ea2-a64c-623209fed4b5 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.109771 Jan 14 09:49:52.313698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 320/662] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:52 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:53.324496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:53.326423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:53.337014 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:53.338480 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:53.340054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:53.341550 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:53.414292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-292ed953-c602-4fca-9f04-6a88e47d08fc tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.095790 Jan 14 09:49:53.420849 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 343/663] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:53 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:54.429907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:54.432482 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:54.440944 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:54.441392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:54.442786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:54.442786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:54.508942 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d5abcfe4-72ed-44d7-8cd8-a0dd3f687ba1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.086203 Jan 14 09:49:54.510223 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 321/664] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:54 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:55.522263 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:55.523564 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:55.533865 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:55.535727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:55.535727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:55.535727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:55.600688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f085120f-1e71-4d9c-a553-a3ba0ac0918a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.083405 Jan 14 09:49:55.605114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 344/665] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:55 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:56.612534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:56.613517 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:56.620346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:56.620796 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:56.621568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:56.621999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:56.684055 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ecc6d3d5-bfea-4000-bdaa-38e6e3f58b4a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.075040 Jan 14 09:49:56.684696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 322/666] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:56 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:57.695417 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:57.696319 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:57.703694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:57.704149 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:57.704954 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:57.705390 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:57.780811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e6fd7ffe-c39b-4708-93c4-374fef75aef9 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.089292 Jan 14 09:49:57.784163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 345/667] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:57 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:49:58.799456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:58.801388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:58.814400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:58.815623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:58.817461 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:58.818277 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:58.916579 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ac6b840e-92db-452f-bdc4-929145998a9a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.126092 Jan 14 09:49:58.917877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 323/668] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:58 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:59.469854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:59.471071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:59.478778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.479237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.480059 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.480496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.531802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f898e764-a031-411d-ab40-a793f5cb17c1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066451 Jan 14 09:49:59.541659 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 346/669] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:49:59 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 14 09:49:59.636174 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:59.636761 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:59.643942 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.644346 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.645144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.645584 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.673232 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:49:59.756429 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c9b8ff88-3f14-4f55-b63b-9c19eae3859b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 204 len: 0 microversion: 2.1 time: 0.124013 Jan 14 09:49:59.757016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 324/670] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:49:59 2022] DELETE /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:49:59.766158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:49:59.767309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:59.777275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.778004 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.779181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.779637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.931195 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:49:59.935427 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:49:59.937203 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:49:59.939760 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8ed1912d-c6ca-40b3-9fd8-aa6ac788a6f8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1674 microversion: 2.1 time: 0.177176 Jan 14 09:49:59.940594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 347/671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:49:59 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:49:59.950967 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.951897 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:49:59.953285 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:49:59.954098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:00.019462 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b44c2216-57cf-430e-a077-c33194695e01 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.092237 Jan 14 09:50:00.020192 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 325/672] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:49:59 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:00.961415 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:00.968058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:00.977368 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:00.978904 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:00.979838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:00.980355 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.033834 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:01.035643 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:01.045332 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:01.046058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.047228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:01.047822 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.139836 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c04333eb-4573-4c53-ba7c-96c8e8bd67ae tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.111419 Jan 14 09:50:01.140472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 326/673] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:01 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:01.177752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:01.190536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0b79bf77-07c1-4e52-82d2-0220dd4fd612 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1674 microversion: 2.1 time: 0.233504 Jan 14 09:50:01.192251 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 348/674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:00 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1674 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:01.612369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:01.613853 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:01.629099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:01.629857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.631405 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:01.631998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.726859 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-cff728b6-dd49-4543-b376-8990110e0510 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/action" status: 202 len: 0 microversion: 2.1 time: 0.118301 Jan 14 09:50:01.730790 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 327/675] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:01 2022] POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:01.740170 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:01.741556 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:01.753922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:01.755133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.756620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:01.757586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:01.995536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:02.003822 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ee59e1d6-fa02-474a-b41d-232b3e4dfe41 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1752 microversion: 2.1 time: 0.270948 Jan 14 09:50:02.004802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 349/676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:01 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:02.154459 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:02.157769 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:02.167196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:02.168067 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:02.170522 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:02.171332 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:02.209378 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:02.210245 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:02.217303 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:02.217979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:02.218980 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:02.219483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:02.250149 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-59f3aca9-70a3-4cda-8c49-1246f025291d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.101809 Jan 14 09:50:02.251295 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 328/677] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:02 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:02.481795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:02.493286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-306e91d1-41ac-4156-bfd5-b4909098de03 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1674 microversion: 2.1 time: 0.287377 Jan 14 09:50:02.499244 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 350/678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:02 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1674 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:03.031355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:03.032285 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:03.042369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.042648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.043719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.044130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.269074 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:03.272260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:03.307111 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.308049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.312466 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.313491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.391774 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:03.404221 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1d125578-23d9-49b3-84e8-9cde3b0fce91 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.377037 Jan 14 09:50:03.414201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 329/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:03 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:03.414201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-287de79e-feb4-47da-8071-8d9d996435c8 req-fa593ec2-7332-4140-a9b7-bd43193e7c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280d074f-8581-4736-a953-d93b0e2f6c6d", "name": "network-vif-deleted", "tag": "edf55d90-6fff-47ad-a60f-8c3f5d2f8f64"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:03.414201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:03.414201 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:50:03.422013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e119d3a5-be85-43b2-8a27-022ac9c7cabf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 14 microversion: 2.20 time: 0.162038 Jan 14 09:50:03.425277 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 351/680] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:03 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:03.425461 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-287de79e-feb4-47da-8071-8d9d996435c8 req-fa593ec2-7332-4140-a9b7-bd43193e7c31 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.425461 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-287de79e-feb4-47da-8071-8d9d996435c8 req-fa593ec2-7332-4140-a9b7-bd43193e7c31 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.437644 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-287de79e-feb4-47da-8071-8d9d996435c8 req-fa593ec2-7332-4140-a9b7-bd43193e7c31 service nova] Creating event network-vif-deleted:edf55d90-6fff-47ad-a60f-8c3f5d2f8f64 for instance 280d074f-8581-4736-a953-d93b0e2f6c6d on hv-cinder-82160 Jan 14 09:50:03.446196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-287de79e-feb4-47da-8071-8d9d996435c8 req-fa593ec2-7332-4140-a9b7-bd43193e7c31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039502 Jan 14 09:50:03.448084 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 330/681] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:03.517666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:03.518416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:03.529775 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.530304 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.534163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.534655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.603698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:03.604227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:03.604823 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lazy-loading 'fault' on Instance uuid 280d074f-8581-4736-a953-d93b0e2f6c6d {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:50:03.684705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:03.700944 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f65e6a6e-c846-4894-8905-2f6858845f17 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 200 len: 1328 microversion: 2.1 time: 0.187294 Jan 14 09:50:03.702859 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 352/682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:03 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 1328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:04.422277 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:04.423516 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:04.432177 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:04.432993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:04.434311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:04.434972 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:04.440726 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:04.443657 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:04.459049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:04.460586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:04.462683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:04.463519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:04.557545 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0e8b0bcf-58d0-4930-88b2-5f33c76a6464 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 7294 microversion: 2.20 time: 0.125692 Jan 14 09:50:04.559092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 353/683] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:04 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 7294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:04.600328 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:04.610706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c8efae98-151e-4d65-b7c6-280f5bfc3fd5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.192012 Jan 14 09:50:04.611408 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 331/684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:04 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:04.719919 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:04.720622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:04.730746 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:04.731208 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:04.732001 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:04.732618 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:04.748498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] HTTP exception thrown: Instance 280d074f-8581-4736-a953-d93b0e2f6c6d could not be found. Jan 14 09:50:04.749364 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Returning 404 to user: Instance 280d074f-8581-4736-a953-d93b0e2f6c6d could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:50:04.750204 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8d3c3c06-8304-4104-8468-f1ed0eacdd00 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 404 len: 111 microversion: 2.1 time: 0.034315 Jan 14 09:50:04.750966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 354/685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:04 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:50:04.759722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5170df7b-b111-4e17-9510-88b141d9a2f0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '.version_select at 0x7fd322128c10>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:04.780128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5170df7b-b111-4e17-9510-88b141d9a2f0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715281194" status: 202 len: 0 microversion: 2.1 time: 0.024288 Jan 14 09:50:04.781801 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 332/686] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jan 14 09:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715281194 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:05.569529 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:05.570652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:05.586242 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:05.590474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:05.594818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:05.595428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:05.636859 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:05.638486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:05.646098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:05.647028 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:05.648764 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:05.650523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:05.721785 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-023d6a30-c468-429a-b826-45dd1ac09f7d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 15641 microversion: 2.20 time: 0.155883 Jan 14 09:50:05.722519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 355/687] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:05 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 15641 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:06.068869 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:06.100825 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-585d4d19-a2fa-41fe-88d1-ca779eff250d tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.474384 Jan 14 09:50:06.105211 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 333/688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:05 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:06.186737 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-29845ac5-50d5-4d79-8353-dd429d3ead61 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: .version_select at 0x7fd327695940>, body: {"keypair": {"name": "tempest-keypair-362527876"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:06.214246 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-29845ac5-50d5-4d79-8353-dd429d3ead61 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:50:06.221020 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-29845ac5-50d5-4d79-8353-dd429d3ead61 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for user 6b960f20a01149e192c66b63f828c1b3 and project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:50:06.441326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-29845ac5-50d5-4d79-8353-dd429d3ead61 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:50:06.448752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-29845ac5-50d5-4d79-8353-dd429d3ead61 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for user 6b960f20a01149e192c66b63f828c1b3 and project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:50:06.464123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-29845ac5-50d5-4d79-8353-dd429d3ead61 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.283444 Jan 14 09:50:06.466496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 356/689] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Jan 14 09:50:06 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:06.734813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:06.735830 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:06.745985 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:06.754059 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:06.755209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:06.755736 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:06.838797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9150e518-dfc6-46e3-8377-b9877415285c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 18449 microversion: 2.20 time: 0.108614 Jan 14 09:50:06.839455 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 334/690] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:06 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 18449 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:07.125224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:07.128236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:07.138367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:07.139262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:07.140968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:07.143284 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:07.707112 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:07.716271 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-741cb77b-6d3d-4a2d-ac33-b5af0d8cefd7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.597947 Jan 14 09:50:07.720017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 357/691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:07 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:07.854558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:07.856644 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:07.887780 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:07.889108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:07.898265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:07.899777 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:08.000074 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8c2c9bf5-9616-421e-93ec-b698a95a7557 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 20758 microversion: 2.20 time: 0.150371 Jan 14 09:50:08.001922 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 335/692] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:07 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 20758 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:08.742337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:08.744187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:08.753086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:08.753835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:08.755174 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:08.755811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:08.773095 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1810773143", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af3523e0-4f7f-4d39-a66e-eb6ac45ad243"}], "security_groups": [{"name": "tempest-securitygroup--1785755388"}], "key_name": "tempest-keypair-362527876", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:09.027546 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:09.035992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-768b89a5-b938-4542-9b64-87b69b4e16bf tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.298629 Jan 14 09:50:09.036889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 358/693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:08 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:09.042816 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:09.044038 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:09.053217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:09.053948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:09.054792 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:09.055238 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:09.141863 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-63dd4dd7-ed17-4cc1-86df-8c04ebfa8b31 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 22798 microversion: 2.20 time: 0.103179 Jan 14 09:50:09.143049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 359/694] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:09 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 22798 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:09.152930 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] validate_networks() for [('af3523e0-4f7f-4d39-a66e-eb6ac45ad243', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:50:09.981202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:50:09.981835 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:50:09.982287 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:50:09.982727 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:50:09.983326 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:50:10.000324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:10.000671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:10.001539 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:10.002165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:10.022181 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:50:10.028602 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Getting quotas for user 6b960f20a01149e192c66b63f828c1b3 and project b91bf1f42e4b4e9c8453d4c7a44f8a30. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:50:10.044880 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:50:10.049274 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:50:10.054182 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:10.054925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:10.070937 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:10.072216 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:10.073986 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:10.074684 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:10.101534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-adc55fdd-1bca-4cbf-b224-de0fe85232a9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.332779 Jan 14 09:50:10.102655 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 336/695] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:50:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:50:10.120225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-89e19713-1cf2-4953-9e46-cd139b4dc2db tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:10.121754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-89e19713-1cf2-4953-9e46-cd139b4dc2db tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:10.212312 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-89e19713-1cf2-4953-9e46-cd139b4dc2db tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:10.221846 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-89e19713-1cf2-4953-9e46-cd139b4dc2db tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1237 microversion: 2.1 time: 0.110146 Jan 14 09:50:10.236209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 337/696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:10 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1237 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:10.242328 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:10.243925 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:10.251233 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:10.252003 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:10.253006 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:10.253607 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:10.346284 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-31ddf039-1747-4774-aeff-0b9e905196e2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 24270 microversion: 2.20 time: 0.107826 Jan 14 09:50:10.347239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 338/697] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:10 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 24270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:10.452085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:10.471051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-975b1071-f2c1-4a30-8633-d8095df685e5 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.420636 Jan 14 09:50:10.472270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 360/698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:10 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:11.243943 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:11.245507 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:11.254137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:11.254940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:11.255953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:11.256617 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:11.359045 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:11.359981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:11.397697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:11.406306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:11.407892 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:11.408097 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:11.408383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:11.422086 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2ff458d4-3676-4d4b-b4f1-1f54e18d7f95 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1289 microversion: 2.1 time: 0.183323 Jan 14 09:50:11.425938 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 339/699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:11 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1289 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:11.503062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:11.503696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:11.512466 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:11.515039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:11.516038 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:11.516336 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:11.530459 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1591b92c-3010-4226-aa01-e4d2bc5c4a04 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 25868 microversion: 2.20 time: 0.173119 Jan 14 09:50:11.532299 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 361/700] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:11 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 25868 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:11.995637 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:12.018632 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-690b1d7c-4c9a-473a-b8cf-3a99236e5f8b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.519201 Jan 14 09:50:12.029230 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 340/701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:11 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:12.442253 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:12.443139 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:12.455274 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:12.455994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:12.456987 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:12.457620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:12.543893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:12.545699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:12.554425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:12.555234 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:12.556306 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:12.557469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:12.652938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:12.670712 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9be2628f-d6cc-4dd3-882f-819f23d33d3c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 27104 microversion: 2.20 time: 0.131199 Jan 14 09:50:12.672408 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 341/702] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:12 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 27104 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:12.684009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b833adb7-da51-4173-8ac0-7c121458fa0a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1295 microversion: 2.1 time: 0.243003 Jan 14 09:50:12.685148 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 362/703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:12 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1295 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:13.039867 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:13.040662 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:13.057871 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:13.058619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:13.065199 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:13.065681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:13.508221 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:13.532242 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6cdb6786-a40b-4083-9e3a-55bd8fd2b4ad tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.493416 Jan 14 09:50:13.533102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 342/704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:13 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:13.689694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:13.691630 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:13.702840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:13.704227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:13.717603 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:13.720221 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:13.728945 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:13.730035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:13.730543 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:13.731377 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:13.732232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:13.733550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:13.845706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ecafcf0f-5a5f-40c9-861b-539936d856c2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 27806 microversion: 2.20 time: 0.162345 Jan 14 09:50:13.849812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 363/705] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:13 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 27806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:14.202333 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:14.213673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7bc7649f-47c0-44be-9b6c-1a1fe7d2dd07 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.514972 Jan 14 09:50:14.216684 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 343/706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:13 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:14.557985 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:14.562498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:14.598997 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:14.604114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:14.612658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:14.614941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:14.821283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-071db45e-9e27-497a-a1e1-4e0e9a0b86ac req-2a5ef5c7-4a43-4bec-9abe-81b057893ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2e7fc55-1db6-4690-91fe-b670f423d724", "tag": "dc36e5cb-1909-4c3c-96b7-4a056ca07482"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:14.843135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:14.843135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:50:14.889359 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-071db45e-9e27-497a-a1e1-4e0e9a0b86ac req-2a5ef5c7-4a43-4bec-9abe-81b057893ce0 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:14.890549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-071db45e-9e27-497a-a1e1-4e0e9a0b86ac req-2a5ef5c7-4a43-4bec-9abe-81b057893ce0 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:14.921028 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-071db45e-9e27-497a-a1e1-4e0e9a0b86ac req-2a5ef5c7-4a43-4bec-9abe-81b057893ce0 service nova] Creating event network-changed:dc36e5cb-1909-4c3c-96b7-4a056ca07482 for instance c2e7fc55-1db6-4690-91fe-b670f423d724 on hv-cinder-82160 Jan 14 09:50:14.935550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-071db45e-9e27-497a-a1e1-4e0e9a0b86ac req-2a5ef5c7-4a43-4bec-9abe-81b057893ce0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131576 Jan 14 09:50:14.938643 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 344/707] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:14.950959 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:14.957050 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:14.967610 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:14.968355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:14.970508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:14.971213 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:15.058573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d26a956e-03a3-4053-904c-5de050db245b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28176 microversion: 2.20 time: 0.113043 Jan 14 09:50:15.059214 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 345/708] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:14 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28176 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:15.089714 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:15.116420 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bd8540c8-21c1-402a-b8f1-d561e7f11eb4 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.567075 Jan 14 09:50:15.122454 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 364/709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:14 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:15.241642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:15.242343 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:15.255068 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:15.256319 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:15.259460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:15.260711 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:15.783617 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:15.805863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7ccebbc4-d9ac-44ea-8053-58d66ef01a5e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.569158 Jan 14 09:50:15.807716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 346/710] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:15 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:16.075427 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:16.082155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:16.122918 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:16.127882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:16.129618 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:16.130339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:16.136708 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:16.139715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:16.156639 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:16.159264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:16.163745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:16.164547 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:16.278159 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6a90b5ec-c378-4f10-84b6-40dcc46e5bc1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28176 microversion: 2.20 time: 0.201399 Jan 14 09:50:16.282671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 365/711] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:16 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28176 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:16.827341 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:16.828218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:16.840303 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:16.841045 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:16.842028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:16.842678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:17.014173 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:17.023263 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e44f0aa6-930f-45ad-b1e1-53aeda39a615 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.889873 Jan 14 09:50:17.024929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 347/712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:16 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:17.208967 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:17.218222 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-775b68ec-b265-42d9-a9d3-0882bfa9abbb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.398169 Jan 14 09:50:17.220542 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 366/713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:16 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:17.291869 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:17.293465 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:17.310542 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:17.318682 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:17.319932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:17.321910 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:17.418803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-24e4aa75-605f-4e8e-b92d-8dfce6898168 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28467 microversion: 2.20 time: 0.129123 Jan 14 09:50:17.418803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 348/714] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:17 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28467 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:17.650163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-61b1bcc6-2e74-42cf-a591-c9e7feeb6a5c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Action: 'create', calling method: .version_select at 0x7fd321b1cee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1648902341"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:17.676729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-61b1bcc6-2e74-42cf-a591-c9e7feeb6a5c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:50:17.688173 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-61b1bcc6-2e74-42cf-a591-c9e7feeb6a5c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for user 1370e932bb594168b377811603f1b46f and project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:50:17.847577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-61b1bcc6-2e74-42cf-a591-c9e7feeb6a5c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:50:17.858260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-61b1bcc6-2e74-42cf-a591-c9e7feeb6a5c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for user 1370e932bb594168b377811603f1b46f and project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'key_pairs'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:50:17.898625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-61b1bcc6-2e74-42cf-a591-c9e7feeb6a5c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.509441 Jan 14 09:50:17.900530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 367/715] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Jan 14 09:50:17 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:18.044250 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:18.046803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:18.055418 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:18.056353 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:18.057236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:18.057766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:18.243399 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:18.249478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:18.270837 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:18.271854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:18.274292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:18.283103 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:18.447424 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:18.471659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c4512586-5354-4662-a7b2-5d6118f398c7 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1757 microversion: 2.1 time: 0.432431 Jan 14 09:50:18.494217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 349/716] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:18 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1757 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:18.509144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:18.511891 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:18.526883 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:18.528220 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:18.529945 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:18.530887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:18.620625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:18.638757 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b56f6f1f-c054-4f81-8313-10eb54a2d75a tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.403946 Jan 14 09:50:18.640891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 368/717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:18 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:18.667541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d3036da2-b36e-486f-917b-894e5ffac786 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28635 microversion: 2.20 time: 0.170010 Jan 14 09:50:18.675588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 350/718] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:18 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28635 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:19.515620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:19.517825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:19.545677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:19.547105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:19.549779 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:19.551818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:19.659701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:19.660569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:19.681354 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:19.681564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:19.682318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:19.683707 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:19.916807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:19.946735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cb08a50c-50e9-410a-9deb-d90ea78c6f0f tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1760 microversion: 2.1 time: 0.441197 Jan 14 09:50:19.965105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 369/719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:19 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1760 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:19.987003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:19.988489 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:19.995423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:19.996237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:19.997367 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:19.998123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:20.077904 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:20.094509 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-711d6de1-2c8b-4db5-b305-7a8fb9858173 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.440200 Jan 14 09:50:20.095703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 351/720] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:19 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:20.132444 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a0d87b76-c3af-4152-914f-29c901aad399 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28635 microversion: 2.20 time: 0.165153 Jan 14 09:50:20.133344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 370/721] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:19 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28635 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:21.130693 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:21.133525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:21.144293 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:21.145335 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:21.156010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:21.156826 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:21.157711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:21.157935 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:21.158264 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:21.158618 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:21.159442 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:21.159882 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:21.229233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d5369cbd-c0bd-4a3e-bdd0-fabe100ed51a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28635 microversion: 2.20 time: 0.088746 Jan 14 09:50:21.229912 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 371/722] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:21 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28635 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:21.327650 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:21.338088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-34944d54-e7fb-43e0-b3a4-2cde22fbd7ad tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.219638 Jan 14 09:50:21.347892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 352/723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:21 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:22.239722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-8531aae1-d41d-49b6-9cfc-4cdceb50cb84 req-8c1a96cc-135d-486c-a61a-358943216a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e7fc55-1db6-4690-91fe-b670f423d724", "name": "network-vif-plugged", "status": "completed", "tag": "dc36e5cb-1909-4c3c-96b7-4a056ca07482"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:22.242829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:22.242829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:50:22.247775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:22.249561 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:22.265961 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-8531aae1-d41d-49b6-9cfc-4cdceb50cb84 req-8c1a96cc-135d-486c-a61a-358943216a8a service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:22.266655 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:22.267601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-8531aae1-d41d-49b6-9cfc-4cdceb50cb84 req-8c1a96cc-135d-486c-a61a-358943216a8a service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:22.269731 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:22.271724 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:22.274776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:22.292540 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-8531aae1-d41d-49b6-9cfc-4cdceb50cb84 req-8c1a96cc-135d-486c-a61a-358943216a8a service nova] Creating event network-vif-plugged:dc36e5cb-1909-4c3c-96b7-4a056ca07482 for instance c2e7fc55-1db6-4690-91fe-b670f423d724 on hv-cinder-82160 Jan 14 09:50:22.308856 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-8531aae1-d41d-49b6-9cfc-4cdceb50cb84 req-8c1a96cc-135d-486c-a61a-358943216a8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073776 Jan 14 09:50:22.309482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 372/724] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:22.359915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:22.360699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:22.387683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:22.388834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:22.390639 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:22.391403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:22.404430 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-006f9df2-140a-4d53-8609-94a627ee514a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 28754 microversion: 2.20 time: 0.164807 Jan 14 09:50:22.406673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 353/725] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:22 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 28754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:22.817988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:22.832427 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-943b1dfb-95f7-4f63-b531-cad4cdf242e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.477724 Jan 14 09:50:22.837565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 373/726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:22 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:23.656779 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:23.659153 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:23.667113 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:23.667568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:23.668381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:23.672447 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:23.765164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-02e4d3cf-172a-4b2e-a912-7830ce47a837 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 30691 microversion: 2.20 time: 0.348661 Jan 14 09:50:23.766495 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 354/727] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:23 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 30691 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:23.855701 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:23.856605 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:23.864660 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:23.865187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:23.866085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:23.866673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:24.032005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:24.039993 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1b276d37-2411-4574-876a-b84c472c4470 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1363 microversion: 2.1 time: 0.190562 Jan 14 09:50:24.040590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 374/728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:23 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:24.779573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:24.781130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:24.789945 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:24.790425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:24.791268 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:24.791712 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:24.877637 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1be9ee44-caca-4352-9b21-247665173965 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 31998 microversion: 2.20 time: 0.104167 Jan 14 09:50:24.878336 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 355/729] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:24 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 31998 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:25.058874 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:25.060069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:25.070897 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:25.071678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:25.073058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:25.073828 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:25.224184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:25.235856 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0ba35320-4df7-4c9e-a302-2524bc832e64 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1548 microversion: 2.1 time: 0.182012 Jan 14 09:50:25.236621 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 375/730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:25 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:25.254106 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:25.254735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:25.262401 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:25.262866 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:25.263672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:25.264115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:25.359112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-27617a32-5d2e-403c-9f49-9e70a4cb9af8 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108997 Jan 14 09:50:25.360071 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 356/731] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jan 14 09:50:25 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:25.890725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:25.892210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:25.900259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:25.900800 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:25.901671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:25.902109 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:25.998840 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-39c22597-c68e-40fd-837a-60d1cc015f06 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 33233 microversion: 2.20 time: 0.112357 Jan 14 09:50:25.999501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 376/732] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:25 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 33233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:26.772773 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-48109110-1fee-4fcb-b3cb-d2db2508bac1 req-b6fcc0a3-e64f-4073-885a-5941b17b349f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2e7fc55-1db6-4690-91fe-b670f423d724", "tag": "dc36e5cb-1909-4c3c-96b7-4a056ca07482"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:26.777408 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:26.777408 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:50:26.796369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-48109110-1fee-4fcb-b3cb-d2db2508bac1 req-b6fcc0a3-e64f-4073-885a-5941b17b349f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:26.796369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-48109110-1fee-4fcb-b3cb-d2db2508bac1 req-b6fcc0a3-e64f-4073-885a-5941b17b349f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:26.816077 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:26.818906 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:26.823083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-48109110-1fee-4fcb-b3cb-d2db2508bac1 req-b6fcc0a3-e64f-4073-885a-5941b17b349f service nova] Creating event network-changed:dc36e5cb-1909-4c3c-96b7-4a056ca07482 for instance c2e7fc55-1db6-4690-91fe-b670f423d724 on hv-cinder-82160 Jan 14 09:50:26.831590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:26.833437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-48109110-1fee-4fcb-b3cb-d2db2508bac1 req-b6fcc0a3-e64f-4073-885a-5941b17b349f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180021 Jan 14 09:50:26.834598 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:26.838936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:26.840984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:26.841176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 377/733] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:26.950988 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9eed9753-31dc-429c-a653-85d2a3131236 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.299066 Jan 14 09:50:26.953179 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 357/734] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:26 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:27.017084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:27.019115 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:27.036821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:27.038051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:27.040846 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:27.041634 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:27.138067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cf0ddb20-7bc0-4a80-ab11-25a79481e322 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 33896 microversion: 2.20 time: 0.128416 Jan 14 09:50:27.139828 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 378/735] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:27 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 33896 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:27.967206 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:27.969356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:27.980722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:27.981388 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:27.982457 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:27.983054 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:28.062953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c7e9f55b-420b-4501-b2db-6fd1b8f472b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.101552 Jan 14 09:50:28.063918 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 358/736] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:27 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:28.153954 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:28.155537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:28.165063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:28.165674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:28.166637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:28.167212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:28.259023 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-635dc4a4-ad76-4f58-91ca-58cbf20823c4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 34933 microversion: 2.20 time: 0.109092 Jan 14 09:50:28.261275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 379/737] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:28 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 34933 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:50:29.076699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:29.077771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:29.088286 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:29.089016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:29.090177 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:29.090668 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:29.275868 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:29.277043 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:29.287796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:29.288249 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:29.289576 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:29.290013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:31.885163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c77e5ab7-df94-4bd4-9a1a-2ec4f6a6729c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 2.812742 Jan 14 09:50:31.885846 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 359/738] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:29 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:31.912698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8738b532-31a1-44ec-968d-846c01d13feb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 38040 microversion: 2.20 time: 2.641188 Jan 14 09:50:31.913301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 380/739] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:29 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 38040 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:32.899438 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:32.901587 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:32.910056 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:32.910635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:32.912103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:32.912103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:32.925627 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:32.926791 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:32.935609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:32.936388 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:32.937290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:32.937780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:32.993320 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-86ff2235-a494-4685-8304-0177d3c4adc0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.097970 Jan 14 09:50:32.994178 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 360/740] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:32 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 14 09:50:33.024484 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d49f2253-0df5-4d72-ade4-a2041a2a5ff2 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 38191 microversion: 2.20 time: 0.102927 Jan 14 09:50:33.030702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 381/741] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:32 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 38191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:34.005922 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:34.007011 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:34.014897 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:34.015355 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:34.016169 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:34.016619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:34.041207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:34.042423 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:34.052424 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:34.052876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:34.053698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:34.054139 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:34.090365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a9d118e9-1626-41c1-9474-fe4908b5c8e1 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.088466 Jan 14 09:50:34.091168 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 361/742] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:34 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:34.158785 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-796df928-64dd-4bab-9790-00e2aef0d624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 38191 microversion: 2.20 time: 0.123456 Jan 14 09:50:34.159444 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 382/743] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:34 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 38191 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:35.102711 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:35.103740 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:35.111526 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:35.111987 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:35.112819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:35.113266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:35.171632 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:35.172753 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:35.178216 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-44a9393a-d06f-4ee1-9ce6-afbdb16e477b tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.079508 Jan 14 09:50:35.181892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 362/744] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:35 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:35.182158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:35.182158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:35.182158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:35.182601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:35.274442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-bd2234e5-673f-44c0-be27-6172111fbf96 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 200 len: 38334 microversion: 2.20 time: 0.105522 Jan 14 09:50:35.275557 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 383/745] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:35 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 38334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 14 09:50:35.286689 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:35.287341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:35.294910 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:35.295414 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:35.296348 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:35.296829 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:35.324060 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a535a08f-f6bc-42b4-bc75-9d4344910c85 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/ips" status: 200 len: 152 microversion: 2.20 time: 0.041597 Jan 14 09:50:35.324646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 363/746] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jan 14 09:50:35 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:36.191610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:36.192770 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:36.200416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:36.200941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:36.201797 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:36.202294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:36.267363 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a7024ac4-d0be-4e2b-9087-0ddb3ccf7cf6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.080841 Jan 14 09:50:36.268013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 384/747] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:36 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:37.284166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:37.286023 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:37.296976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:37.297535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:37.298555 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:37.299134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:37.364152 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4e6744a8-a15e-4542-bf70-b01f6a42f185 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.088255 Jan 14 09:50:37.367260 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 364/748] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:37 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:37.700649 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:37.702286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:37.717124 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:37.718426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:37.720318 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:37.721503 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:37.761102 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lazy-loading 'flavor' on Instance uuid 0db101fb-52af-4565-b50f-e4b0ca94ad18 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:50:37.776385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1806184008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1648902341", "security_groups": [{"name": "tempest-secgroup-smoke-38373261"}], "block_device_mapping_v2": [{"uuid": "3c71be79-73ab-41b6-9f48-c5fdf1b942d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80c10abc-4f06-43c3-8b66-e45b72fd3048"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:37.946868 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] validate_networks() for [('80c10abc-4f06-43c3-8b66-e45b72fd3048', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:50:38.148328 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-129e693c-b0d5-42d7-91e9-d6a3faa11a62 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 202 len: 0 microversion: 2.20 time: 0.458026 Jan 14 09:50:38.152294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 385/749] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:50:37 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:50:38.160687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:38.162260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:38.171548 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:38.172237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:38.173479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:38.174262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:38.408766 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:38.421975 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:38.423848 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:38.425112 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-569d2460-2d14-4f9d-827e-1a0e668317c6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.269973 Jan 14 09:50:38.425687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 386/750] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:38 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:50:38.439942 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:38.441248 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:38.457652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:38.458265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:38.459441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:38.460030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:38.525318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:50:38.526026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:50:38.526892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:50:38.527564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:50:38.528283 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:50:38.535306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fb326dc7-0e7c-446b-839d-ca16515835bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.099153 Jan 14 09:50:38.536296 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 387/751] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:38 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:38.543518 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:38.544252 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:38.545635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:38.546458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:38.577912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:50:38.587111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for user 1370e932bb594168b377811603f1b46f and project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:50:38.652459 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:50:38.656957 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c71be79-73ab-41b6-9f48-c5fdf1b942d8',volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:50:38.805574 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2a14ba74-1fc7-4f65-8c34-386a4518f238 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.034750 Jan 14 09:50:38.806245 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 365/752] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:50:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:50:38.817155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0ca23d81-ca95-41f4-8a66-8c3f89b56e6f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:38.818101 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0ca23d81-ca95-41f4-8a66-8c3f89b56e6f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:38.908730 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0ca23d81-ca95-41f4-8a66-8c3f89b56e6f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:38.925012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0ca23d81-ca95-41f4-8a66-8c3f89b56e6f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1095 microversion: 2.1 time: 0.111561 Jan 14 09:50:38.926559 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 388/753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:38 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1095 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:39.450857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:39.452809 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:39.465111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:39.465924 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:39.467405 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:39.468217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:39.550699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:39.552429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:39.565319 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:39.566376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:39.568380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:39.569197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:39.671666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e03d3c65-7d78-478c-9305-e08eca55f77e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 14 microversion: 2.1 time: 0.127951 Jan 14 09:50:39.671932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:39.673527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 389/754] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:39 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:50:39.682239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:39.684109 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:39.685344 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aaaa05c8-b14b-4143-a429-0196977617bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.243791 Jan 14 09:50:39.685919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 366/755] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:39 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:39.955528 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:39.956532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:39.966582 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:39.967158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:39.968320 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:39.968838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:40.064551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:40.079063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-377d6944-259e-4988-8aab-18e595559906 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1201 microversion: 2.1 time: 0.128810 Jan 14 09:50:40.080889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 390/756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:39 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1201 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:40.687783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:40.691551 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:40.709465 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:40.710048 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:40.710950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:40.711520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:40.712850 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:40.713239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:40.728168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:40.728880 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:40.730344 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:40.731184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:40.800993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3afde760-b34c-4a07-81b1-2a445d03e036 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 9366 microversion: 2.1 time: 0.118412 Jan 14 09:50:40.802194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 367/757] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:40 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 9366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:40.967880 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:40.986285 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:40.990050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:40.991733 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d8795768-fe57-473e-9042-6a6386a4426f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.288469 Jan 14 09:50:40.992636 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 391/758] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:40 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:41.101817 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:41.103359 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:41.116986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:41.117797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:41.119313 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:41.120089 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:41.466895 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:41.481194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c50428a1-17b5-4c82-ba98-08f0faeee974 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.386068 Jan 14 09:50:41.482736 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 368/759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:41 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:41.818187 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:41.819562 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:41.830735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:41.831946 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:41.834198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:41.838087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:41.965569 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d20688c5-a583-416a-84cc-8666cab2f6c4 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 15412 microversion: 2.1 time: 0.150687 Jan 14 09:50:41.967919 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 392/760] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:41 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 15412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:42.010030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-f2e210e5-8bf9-44ab-a064-c0d948823d38 req-12a1e568-661d-4515-9222-d066ee900f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56917cca-28b3-42a4-b9e3-b6b97a4b335b", "tag": "4b264089-8f21-4f26-a3f0-1c2c4425bbdd"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:42.016117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:42.016117 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:50:42.026613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:42.028315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:42.036460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-f2e210e5-8bf9-44ab-a064-c0d948823d38 req-12a1e568-661d-4515-9222-d066ee900f50 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.037255 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-f2e210e5-8bf9-44ab-a064-c0d948823d38 req-12a1e568-661d-4515-9222-d066ee900f50 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:42.044269 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.045933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:42.049327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.050558 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:42.067517 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-f2e210e5-8bf9-44ab-a064-c0d948823d38 req-12a1e568-661d-4515-9222-d066ee900f50 service nova] Creating event network-changed:4b264089-8f21-4f26-a3f0-1c2c4425bbdd for instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b on hv-cinder-82160 Jan 14 09:50:42.080398 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-f2e210e5-8bf9-44ab-a064-c0d948823d38 req-12a1e568-661d-4515-9222-d066ee900f50 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077547 Jan 14 09:50:42.081942 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 369/761] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:42.290067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:42.306850 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:42.310227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:42.312682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a031c8a3-de29-41ce-8a37-5abb929d660b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.294300 Jan 14 09:50:42.313571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 393/762] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:42 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:50:42.505973 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:42.507115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:42.514786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.515433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:42.516598 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.517177 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:42.770654 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:42.789318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d65c8724-958c-4b80-b151-10374ab6391d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.286899 Jan 14 09:50:42.790768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 370/763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:42 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:42.985656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:42.986852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:42.994987 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.995827 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:42.996964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:42.997483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:43.075813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a3711e35-2f3d-4f03-bdee-acfeb228be9f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 18153 microversion: 2.1 time: 0.096447 Jan 14 09:50:43.079277 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 394/764] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:42 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 18153 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:43.332634 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:43.333256 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:43.340302 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:43.340764 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:43.341567 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:43.342007 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:43.552489 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:43.567979 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:43.571130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:43.573300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dd8df544-a76b-4338-a854-fc5270fe5371 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.244340 Jan 14 09:50:43.574334 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 371/765] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:43 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:43.812886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:43.813501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:43.821443 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:43.821954 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:43.822848 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:43.823352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:43.978641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:43.986739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6fa764ac-34b1-454e-aada-33024209dacc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.179931 Jan 14 09:50:43.987470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 395/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:43 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:44.089847 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:44.090694 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:44.097055 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:44.097589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:44.098557 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:44.099137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:44.179913 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-62e3c7ac-37a0-4bfe-bcb1-44a82370e327 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 19342 microversion: 2.1 time: 0.093257 Jan 14 09:50:44.180584 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 372/767] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:44 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 19342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:44.608678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:44.609720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:44.621643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:44.622472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:44.623924 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:44.624704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:44.824094 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:44.833216 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:44.834874 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:44.836372 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e95dc61b-3d3f-4a5c-be23-242d0f1fe279 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.234532 Jan 14 09:50:44.837024 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 396/768] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:44 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:45.005362 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:45.006038 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:45.013649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:45.014120 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:45.014964 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:45.015404 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:45.167737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:45.178967 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f95ad9e8-e495-4394-8470-8be636497c16 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.177788 Jan 14 09:50:45.179646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 373/769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:44 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:45.198192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:45.199650 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:45.211573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:45.212218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:45.213421 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:45.214013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:45.313071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a3358225-5a1c-49be-9944-e5d658663dde tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 21966 microversion: 2.1 time: 0.122126 Jan 14 09:50:45.313717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 397/770] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:45 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 21966 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:45.856331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:45.857125 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:45.864523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:45.864983 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:45.865803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:45.868714 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:46.041573 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:46.055124 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:46.058149 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:46.060147 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9d0fc7b6-7d0f-4f5c-a1b3-a0a0788d8923 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.207516 Jan 14 09:50:46.061034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 374/771] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:45 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:46.201722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:46.203127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:46.215801 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:46.216294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:46.217182 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:46.217927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:46.325648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:46.326934 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:46.336078 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:46.336546 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:46.337371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:46.337807 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:46.384407 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:46.393354 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-273cb958-765a-4a10-9957-92ad6a1fd011 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.199575 Jan 14 09:50:46.394082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 398/772] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:46 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:46.418515 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4b395490-2038-4c48-b519-79cf4fd27143 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 23226 microversion: 2.1 time: 0.097461 Jan 14 09:50:46.419168 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 375/773] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:46 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 23226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:47.080133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:47.080842 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:47.088646 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:47.089149 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:47.090011 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:47.090561 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:47.248089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:47.256675 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:47.258339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:47.259588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-668dd3e1-664b-48e5-80c0-25bd69ad2ae4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.183516 Jan 14 09:50:47.260165 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 399/774] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:47 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:47.411550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:47.412263 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:47.420057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:47.420554 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:47.421420 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:47.421920 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:47.431231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:47.434506 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:47.444747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:47.445524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:47.446949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:47.447417 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:47.568973 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2a17a7d6-dd3b-42a9-853c-b13e7705e99d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 24108 microversion: 2.1 time: 0.142420 Jan 14 09:50:47.570540 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 400/775] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:47 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 24108 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:47.605804 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:47.613798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7807bcaf-7d57-4d9b-822f-e1f772a86568 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.206215 Jan 14 09:50:47.614420 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 376/776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:47 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:48.279378 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:48.279995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:48.287029 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:48.287484 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:48.288290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:48.288730 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:48.582389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:48.583228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:48.590173 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:48.590642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:48.591452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:48.591886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:48.684431 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3bcea259-49b5-49d0-91c7-e09ec4c74d8e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 25113 microversion: 2.1 time: 0.105624 Jan 14 09:50:48.685552 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 377/777] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:48 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 25113 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:48.695154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:48.696731 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:48.709536 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:48.710337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:48.711880 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:48.712575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:48.717500 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:48.727847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:48.729925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:48.731594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f34ed1fd-1d0f-4b8e-a866-476852c1771d tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.456389 Jan 14 09:50:48.732258 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 401/778] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:48 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:48.896774 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:48.909295 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dcf65385-7d34-45e6-9784-e3f08fc0115b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.221013 Jan 14 09:50:48.909858 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 378/779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:48 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:49.699395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:49.700394 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:49.709484 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:49.709940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:49.710843 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:49.711283 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:49.755538 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:49.756096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:49.763026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:49.763472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:49.764274 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:49.764791 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:49.792921 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f3ee0e97-71ee-4e8e-9b30-f977fe013c6d tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 26109 microversion: 2.1 time: 0.097143 Jan 14 09:50:49.793590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 402/780] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:49 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 26109 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:49.906594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:49.914978 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:49.916469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:49.917638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b16735c4-b2d7-4504-8a86-6a7938fd1624 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.166060 Jan 14 09:50:49.918188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 379/781] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:49 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:50:49.927314 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:49.928096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:49.936100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:49.936551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:49.937347 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:49.937787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:50.085418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:50.093365 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1519b85f-0732-4222-af15-8e3c1f742c59 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.169899 Jan 14 09:50:50.094116 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 403/782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:49 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:50.809710 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:50.811462 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:50.822738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:50.823955 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:50.825112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:50.825903 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:50.912168 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-fd1e68aa-e423-4dd0-9465-6307637bb0b5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 26920 microversion: 2.1 time: 0.110425 Jan 14 09:50:50.912827 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 380/783] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:50 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 26920 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:50.935989 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:50.936615 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:50.943421 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:50.943872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:50.945228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:50.945666 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:51.096146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:51.111487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:51.114292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:51.114497 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:51.115514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:51.117181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5a0cf0cc-e1c3-4f26-be72-34d2efa9eb2c tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.184271 Jan 14 09:50:51.118215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 404/784] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:50 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:51.126044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:51.126747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:51.127831 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:51.128594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:51.281665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:51.290453 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-87ab9aad-7650-4b3d-a49d-6911779bee49 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.182933 Jan 14 09:50:51.291099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 381/785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:51 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:51.923928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:51.924832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:51.931302 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:51.931748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:51.932523 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:51.933219 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:52.017757 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-01eba968-ba2e-4f25-9035-9423c7bf9ae5 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 27554 microversion: 2.1 time: 0.097300 Jan 14 09:50:52.018463 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 405/786] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:51 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 27554 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:52.145757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:52.146648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:52.156044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:52.156498 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:52.157821 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:52.158337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:52.313760 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:52.315307 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:52.328197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:52.329489 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:52.331535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:52.332513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:52.389099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:52.401410 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:52.403402 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:52.405914 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d7d58943-6bc5-4300-bc93-c89b18456922 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.264211 Jan 14 09:50:52.408517 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 382/787] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:52 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:52.539235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:52.551619 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ae115709-c29f-4975-aca3-acbbffd367b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.245354 Jan 14 09:50:52.552514 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 406/788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:52 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:52.557055 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-dd07498a-384a-4deb-bfc4-4df2f08537f6 req-e344d9c1-a8ea-4884-8b85-53907b704aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56917cca-28b3-42a4-b9e3-b6b97a4b335b", "name": "network-vif-plugged", "status": "completed", "tag": "4b264089-8f21-4f26-a3f0-1c2c4425bbdd"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:52.560574 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:52.560574 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:50:52.569476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-dd07498a-384a-4deb-bfc4-4df2f08537f6 req-e344d9c1-a8ea-4884-8b85-53907b704aea service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:52.569949 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-dd07498a-384a-4deb-bfc4-4df2f08537f6 req-e344d9c1-a8ea-4884-8b85-53907b704aea service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:52.582553 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-dd07498a-384a-4deb-bfc4-4df2f08537f6 req-e344d9c1-a8ea-4884-8b85-53907b704aea service nova] Creating event network-vif-plugged:4b264089-8f21-4f26-a3f0-1c2c4425bbdd for instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b on hv-cinder-82160 Jan 14 09:50:52.588338 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-dd07498a-384a-4deb-bfc4-4df2f08537f6 req-e344d9c1-a8ea-4884-8b85-53907b704aea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133866 Jan 14 09:50:52.591291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 383/789] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:50:53.029884 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:53.030894 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:53.038160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:53.038784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:53.039833 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:53.040335 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:53.214640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ddd31ef9-eb4b-4502-a01f-52e7a9355543 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 27893 microversion: 2.1 time: 0.188507 Jan 14 09:50:53.215327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 407/790] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:53 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 27893 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:53.435115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:53.437025 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:53.449929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:53.451479 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:53.454098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:53.455112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:53.571012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:53.571829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:53.580494 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:53.580953 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:53.581764 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:53.582207 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:53.662228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:53.676345 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:53.679058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:53.680852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-429c5cda-9ea6-49c2-b29c-db2e7142db8b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.253758 Jan 14 09:50:53.681808 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 384/791] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:53 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:53.746907 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:53.759010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fad817b5-371d-47b7-8fcf-b7b773eb76f0 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1265 microversion: 2.1 time: 0.191983 Jan 14 09:50:53.759587 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 408/792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:53 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:50:54.226554 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:54.227814 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:54.238934 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.240116 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:54.241589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.242395 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:54.334329 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c8e78487-c697-4ea0-9877-11094d0442f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28141 microversion: 2.1 time: 0.110987 Jan 14 09:50:54.335288 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 385/793] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:54 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28141 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:54.700595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:54.701382 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:54.713011 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.713835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:54.715117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.715558 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:54.784907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:54.786112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:54.799047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.799908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:54.801410 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.802476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:54.884338 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:54.895752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:54.897997 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:54.899338 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-90e1d240-cea9-44d6-9897-1c2311e3bc14 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1743 microversion: 2.20 time: 0.202639 Jan 14 09:50:54.900247 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 409/794] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:54 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:50:54.961475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:54.969728 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5f1d49ea-d622-4739-9a55-83f5a04e16ba tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1451 microversion: 2.1 time: 0.192503 Jan 14 09:50:54.970535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 386/795] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:54 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1451 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:54.989882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:54.991368 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:54.998862 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:54.999498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:55.000563 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:55.001034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:55.148309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:55.155879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c7f55249-dbb2-4790-8503-2fbd9564c177 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1451 microversion: 2.1 time: 0.172704 Jan 14 09:50:55.156455 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 410/796] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:50:54 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:50:55.346988 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:55.348231 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:55.355475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:55.355927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:55.356735 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:55.357171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:55.442688 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1fcbdde5-5c65-4b70-a673-b86a1000a0f6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28203 microversion: 2.1 time: 0.099094 Jan 14 09:50:55.443634 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 387/797] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:55 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:50:55.917711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:55.918505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:55.925453 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:55.925982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:55.926886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:55.927397 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:56.189030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:56.200041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:56.201995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:56.203437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-878de4e2-b951-42e7-a57d-63b62aeb6758 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1743 microversion: 2.20 time: 0.289333 Jan 14 09:50:56.204224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 411/798] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:55 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1743 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:50:56.460155 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:56.463136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:56.478394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:56.479415 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:56.480878 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:56.482255 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:56.567367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b04383d8-04ad-4993-9ce1-73afa78d0027 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28203 microversion: 2.1 time: 0.115494 Jan 14 09:50:56.568059 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 388/799] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:56 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:57.222996 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:57.224515 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:57.234708 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:57.235430 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:57.236602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:57.237215 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:57.255970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-ed8394a2-a007-4990-b48b-322ae68b1be5 req-f1c9b547-22cb-43d8-a4ad-528296831205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56917cca-28b3-42a4-b9e3-b6b97a4b335b", "tag": "4b264089-8f21-4f26-a3f0-1c2c4425bbdd"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:57.257475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:57.257475 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:50:57.279813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-ed8394a2-a007-4990-b48b-322ae68b1be5 req-f1c9b547-22cb-43d8-a4ad-528296831205 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:57.280279 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-ed8394a2-a007-4990-b48b-322ae68b1be5 req-f1c9b547-22cb-43d8-a4ad-528296831205 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:57.294476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-ed8394a2-a007-4990-b48b-322ae68b1be5 req-f1c9b547-22cb-43d8-a4ad-528296831205 service nova] Creating event network-changed:4b264089-8f21-4f26-a3f0-1c2c4425bbdd for instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b on hv-cinder-82160 Jan 14 09:50:57.301076 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-ed8394a2-a007-4990-b48b-322ae68b1be5 req-f1c9b547-22cb-43d8-a4ad-528296831205 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060617 Jan 14 09:50:57.302445 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 389/800] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:57.563131 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:57.583641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:57.584250 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:57.585928 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:57.592168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:57.595456 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e48ae31d-a310-45a7-9b92-972bb1cc5e90 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.374815 Jan 14 09:50:57.596068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 412/801] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:57 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:50:57.599663 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:57.604527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:57.613448 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:57.614016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:57.744012 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4d300ff6-72e6-42eb-a7ce-ce5ec954fed9 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28203 microversion: 2.1 time: 0.165401 Jan 14 09:50:57.745472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 390/802] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:57 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:58.550620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-4bfa60da-4182-43ff-a5b4-ab223538e5da req-7484747b-3738-4864-a2b8-4dfaef81a7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "name": "network-vif-plugged", "status": "completed", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:58.552963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:50:58.552963 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:50:58.567677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-4bfa60da-4182-43ff-a5b4-ab223538e5da req-7484747b-3738-4864-a2b8-4dfaef81a7ab service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:58.568417 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-4bfa60da-4182-43ff-a5b4-ab223538e5da req-7484747b-3738-4864-a2b8-4dfaef81a7ab service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:58.587247 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-4bfa60da-4182-43ff-a5b4-ab223538e5da req-7484747b-3738-4864-a2b8-4dfaef81a7ab service nova] Creating event network-vif-plugged:f484129e-42b3-4eed-8bf4-b44de5367943 for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 on hv-cinder-82160 Jan 14 09:50:58.592404 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-4bfa60da-4182-43ff-a5b4-ab223538e5da req-7484747b-3738-4864-a2b8-4dfaef81a7ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045980 Jan 14 09:50:58.593496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 413/803] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:50:58.615564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:50:58.617299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:58.624734 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:58.625499 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:58.626873 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:58.627503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:58.758280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:58.759337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:58.770969 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:58.771431 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:58.772802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:58.783133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:58.894952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0afc0b39-7949-4c97-80b0-326d6e6ce565 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28414 microversion: 2.1 time: 0.140496 Jan 14 09:50:58.896846 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 414/804] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:58 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:50:59.068772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:59.119596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:59.122020 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:50:59.123874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b5ef2bad-d6b4-445c-a00f-4f93dc785abd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.512478 Jan 14 09:50:59.135529 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 391/805] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:50:58 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:50:59.908735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:50:59.910682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:50:59.918381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:59.918826 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:50:59.919812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:50:59.920431 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:00.021723 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-529125b1-a2b0-424c-b63e-7e24c2af1ae0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28494 microversion: 2.1 time: 0.116318 Jan 14 09:51:00.022689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 415/806] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:50:59 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28494 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:00.145144 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:00.146623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:00.156243 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:00.156791 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:00.157715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:00.158242 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:00.335385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:00.344389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:00.346242 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:00.347820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-286a39a0-fd2c-4522-bd55-744d75a4bf87 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.206406 Jan 14 09:51:00.349191 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 392/807] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:00 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:01.037053 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:01.039346 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:01.046694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:01.047138 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:01.047941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:01.048381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:01.139600 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cf3aa852-9418-4a78-b3b9-e36070377ca3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28662 microversion: 2.1 time: 0.109019 Jan 14 09:51:01.142629 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 416/808] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:01 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:01.392371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:01.395702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:01.406993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:01.407889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:01.409156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:01.409716 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:01.584452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:01.600257 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:01.602570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:01.604494 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c0c0e94a-ecbf-42e9-a172-29aec95e3628 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.227397 Jan 14 09:51:01.605370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 393/809] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:01 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:02.154920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:02.156969 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:02.168441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:02.169858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:02.171663 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:02.172701 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:02.279957 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6d024bf5-a1de-4511-b217-1e5ad77218e0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28662 microversion: 2.1 time: 0.129404 Jan 14 09:51:02.288070 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 417/810] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:02 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28662 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:02.627173 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:02.628638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:02.642706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:02.643452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:02.644238 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:02.644679 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:02.828337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:02.841575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:02.843221 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:02.844649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e61b98c8-bda8-487a-ab77-e4997f75a047 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.221690 Jan 14 09:51:02.847224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 394/811] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:02 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:03.299941 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:03.301821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:03.311306 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:03.312395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:03.315064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:03.315965 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:03.398141 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3b892fdb-702f-44f5-a866-b04653c65387 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 28662 microversion: 2.1 time: 0.102104 Jan 14 09:51:03.398829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 418/812] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:03 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 28662 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:51:03.864956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:03.866445 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:03.873272 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:03.873719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:03.874752 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:03.875187 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:04.016839 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:04.028253 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:04.029783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:04.030997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d89fc702-a63a-4991-aa3d-ce8cd3baf9bb tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.169740 Jan 14 09:51:04.031887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 395/813] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:03 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:04.413901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:04.414958 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:04.421602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:04.422082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:04.422900 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:04.423337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:04.505717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d9bcd72b-ea2b-455c-991f-c028532819ec tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 29470 microversion: 2.1 time: 0.096598 Jan 14 09:51:04.510055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 419/814] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:04 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 29470 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:05.052652 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:05.053768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:05.068215 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:05.069064 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:05.070541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:05.071703 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:05.235152 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:05.245480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:05.247025 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:05.248215 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-dee65b57-7be6-4c13-8aaa-2c5e3e0e9087 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.202113 Jan 14 09:51:05.259458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 396/815] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:05 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:05.518260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:05.520353 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:05.529136 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:05.529938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:05.531177 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:05.532721 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:05.638505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a679be01-63bb-4e21-8e90-699cf6f35606 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 31366 microversion: 2.1 time: 0.122747 Jan 14 09:51:05.641467 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 420/816] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:05 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 31366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:06.270618 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:06.273057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:06.286181 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:06.287781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:06.289829 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:06.291297 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:06.516051 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:06.528501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:06.530480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:06.532890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-449b9af1-f664-4b2a-addd-77d3c8d87056 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.268412 Jan 14 09:51:06.534266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 397/817] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:06 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:06.657084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:06.660144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:06.672885 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:06.673631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:06.674763 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:06.675411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:06.758537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6de86104-502d-4a7f-8c68-d8bd257d3b12 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 32879 microversion: 2.1 time: 0.108026 Jan 14 09:51:06.760236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 421/818] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:06 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 32879 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:07.553732 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:07.554439 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:07.561675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:07.562166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:07.563034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:07.563471 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:07.725205 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:07.737314 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:07.739547 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:07.741624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e4d2f044-ec9a-4788-a83d-a310237bf138 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1738 microversion: 2.20 time: 0.191705 Jan 14 09:51:07.742209 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 398/819] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:07 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:07.773333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:07.774361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:07.781532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:07.781995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:07.782844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:07.783291 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:07.890429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1f21d3fa-881e-405b-8a4a-6e6def43853f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 33641 microversion: 2.1 time: 0.121606 Jan 14 09:51:07.891096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 422/820] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:07 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 33641 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:08.760292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:08.760905 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:08.767455 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:08.767890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:08.768702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:08.769142 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:08.902771 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:08.904601 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:08.909100 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:08.911770 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:08.913135 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:08.913949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:08.914655 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:08.919252 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:08.920762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:08.921948 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ea1b4207-9d05-4b45-9a38-4da1d7628c99 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1720 microversion: 2.20 time: 0.166007 Jan 14 09:51:08.922532 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 399/821] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:08 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:08.995546 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b966b90d-ce29-4d91-abe2-0c24019e32dc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 34734 microversion: 2.1 time: 0.096677 Jan 14 09:51:08.996476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 423/822] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:08 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 34734 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:51:09.941348 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:09.941958 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:09.948925 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:09.949375 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:09.950160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:09.950636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:10.008606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:10.009606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:10.016485 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:10.016938 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:10.017725 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:10.018168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:10.084079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:10.091309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1d608df2-e2c4-4bf8-9c07-dfc2b20d9f82 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 35768 microversion: 2.1 time: 0.087058 Jan 14 09:51:10.091979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 424/823] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:10 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 35768 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:51:10.092757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:10.094135 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:10.095361 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ff6d2228-a007-416d-8f69-fc67e6c7519a tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1720 microversion: 2.20 time: 0.157753 Jan 14 09:51:10.096093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 400/824] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:09 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:11.104988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:11.105991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:11.112558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:11.113046 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.113171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:11.113395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.114181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.114640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.119456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.119910 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.120698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.121136 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.189339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-509dbb4f-ba60-4e48-8ce9-495b9a7808b6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 37152 microversion: 2.1 time: 0.088816 Jan 14 09:51:11.193928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 425/825] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:11 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 37152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:11.253155 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:11.261751 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:11.263280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:11.264458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bab36e4f-2a3a-4a68-92ac-e232f21d11e1 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1663 microversion: 2.20 time: 0.155561 Jan 14 09:51:11.265016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 401/826] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:11 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:11.283465 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c26d3503-98e1-42f4-91fe-5011486d4fe6"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:11.284594 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:11.291520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.291970 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.292752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.293186 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.551571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-368f18a6-0e3a-4e51-9949-d780b03af21e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.272217 Jan 14 09:51:11.555085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 426/827] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jan 14 09:51:11 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-volume_attachments => generated 188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:11.673756 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:11.674263 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:11.680889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.681342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.682149 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.682879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.914817 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f161f7e7-047d-480f-af80-6456629654ac tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-volume_attachments/c26d3503-98e1-42f4-91fe-5011486d4fe6" status: 202 len: 0 microversion: 2.20 time: 0.244622 Jan 14 09:51:11.915655 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 402/828] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jan 14 09:51:11 2022] DELETE /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-volume_attachments/c26d3503-98e1-42f4-91fe-5011486d4fe6 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:51:11.969801 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:11.970392 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:11.977424 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.977879 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:11.978706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:11.979158 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:12.061374 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5ce3473c-a9c1-46f6-8165-833d599056ad tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action" status: 202 len: 0 microversion: 2.20 time: 0.095271 Jan 14 09:51:12.062010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 427/829] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jan 14 09:51:11 2022] POST /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:51:12.070973 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:12.071576 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:12.079808 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:12.080438 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:12.081089 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:12.081527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:12.201122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:12.202156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:12.208574 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:12.209185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:12.210010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:12.210483 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:12.256060 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:12.263824 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:12.265337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:12.277934 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b189b2ff-da28-47b3-bc93-94c0324a7d07 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1671 microversion: 2.20 time: 0.200073 Jan 14 09:51:12.278622 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 403/830] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:12 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1671 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:12.298953 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c1a35b92-b0d9-491e-a735-2e404d467394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 38195 microversion: 2.1 time: 0.101294 Jan 14 09:51:12.299606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 428/831] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:12 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 38195 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 14 09:51:12.370049 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-419a399d-cf6e-4819-8e9f-01dbebd1de5b req-0841cc00-2153-4bb6-bd9e-5c04506a329f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "name": "network-vif-unplugged", "status": "completed", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:12.371885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:51:12.371885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:51:12.381450 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-419a399d-cf6e-4819-8e9f-01dbebd1de5b req-0841cc00-2153-4bb6-bd9e-5c04506a329f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:12.382161 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-419a399d-cf6e-4819-8e9f-01dbebd1de5b req-0841cc00-2153-4bb6-bd9e-5c04506a329f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:12.399696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.compute.server_external_events [req-419a399d-cf6e-4819-8e9f-01dbebd1de5b req-0841cc00-2153-4bb6-bd9e-5c04506a329f service nova] Unable to find a host for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18. Dropping event network-vif-unplugged {{(pid=128092) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 14 09:51:12.400470 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-419a399d-cf6e-4819-8e9f-01dbebd1de5b req-0841cc00-2153-4bb6-bd9e-5c04506a329f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034277 Jan 14 09:51:12.401266 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 404/832] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 14 09:51:13.297614 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:13.298228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:13.305556 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:13.306138 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:13.307096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:13.307816 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:13.312591 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:13.314476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:13.322037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:13.322581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:13.323535 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:13.324115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:13.396797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7d470b75-a515-42a9-b560-6538631a27be tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 38195 microversion: 2.1 time: 0.087653 Jan 14 09:51:13.398412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 405/833] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:13 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 38195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:13.463627 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:13.472626 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:13.474115 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:13.476413 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b333b3eb-3328-4db2-acc3-a84ce897dd13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.182977 Jan 14 09:51:13.476977 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 429/834] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:13 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:14.411520 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:14.413384 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:14.421335 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:14.421781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:14.422606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:14.423222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:14.496609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:14.498333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:14.507301 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:14.507748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:14.508740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:14.509808 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:14.671413 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:14.685406 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:14.688275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:14.690311 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-28b48414-3e9d-4064-ade2-d842ed489a52 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.197925 Jan 14 09:51:14.691928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 430/835] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:14 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:15.711151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:15.712064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:15.718773 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:15.719227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:15.720053 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:15.720495 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:15.882037 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:15.892625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:15.894233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:15.895471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-67697bfa-b866-4286-b249-41db22e4c326 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.188147 Jan 14 09:51:15.902322 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 431/836] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:15 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:16.915233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:16.916103 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:16.922790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:16.922790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:16.923573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:16.923999 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:17.067323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:17.076717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:17.078263 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:17.079446 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f1382db5-cee0-46af-ab5e-333649d82229 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.168335 Jan 14 09:51:17.079992 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 432/837] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:16 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:18.097835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:18.099015 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:18.106121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:18.106802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:18.107635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:18.108178 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:18.274055 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:18.284426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:18.284829 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:18.286014 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-238f14a8-4e96-40e5-9fcc-d7fc9d9b9bca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.192580 Jan 14 09:51:18.286690 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 433/838] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:18 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:19.307521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:19.308631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:19.318095 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:19.318674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:19.319689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:19.320144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:19.509288 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:19.533313 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:19.535376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:19.536160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-87093090-0892-4002-8dae-37052a000020 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.234877 Jan 14 09:51:19.537308 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 434/839] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:19 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:20.557814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:20.558609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:20.565784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:20.566237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:20.567084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:20.567534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:20.736401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:20.745536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:20.747093 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:20.748323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-714e2414-fa94-4430-b592-3bf5aade60e4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.196042 Jan 14 09:51:20.749168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 435/840] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:20 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:21.766758 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:21.767702 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:21.775329 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:21.775875 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:21.776753 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:21.777210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:21.922474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:21.931065 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:21.932767 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:21.933964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4924052e-90b7-410a-b047-227a915a0d93 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.171008 Jan 14 09:51:21.934814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 436/841] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:21 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:22.544610 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-473aa8b9-03d7-4c46-837b-d53c9fd252bb tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action" status: 200 len: 38326 microversion: 2.1 time: 8.138249 Jan 14 09:51:22.546208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 406/842] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:14 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/action => generated 38326 bytes in 8141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 14 09:51:22.559184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:22.559711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:22.566133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:22.567013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:22.568130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:22.568582 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:22.603380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f750dfdc-45a1-47b1-97b5-af8948f7be89 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/ips" status: 200 len: 145 microversion: 2.1 time: 0.047656 Jan 14 09:51:22.604699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 437/843] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jan 14 09:51:22 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:22.955034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:22.955909 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:22.964256 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:22.964718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:22.965545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:22.965995 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:23.212217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:23.221683 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:23.223371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:23.225576 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-81cd6298-592a-4964-bd25-9d29b803d9d6 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.275514 Jan 14 09:51:23.226184 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 407/844] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:22 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:23.756695 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1511962193"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:23.757360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:23.764152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:23.764612 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:23.765440 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:23.765885 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:23.898012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.network.security_group_api [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Removing security group 5c3cb225-69b9-491a-9fe7-2f319b407d26 from port a8c563c3-b40e-4151-8a9f-8712800674f9 Jan 14 09:51:23.973364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30b363bd-49b3-44fc-895d-7b2d01581ca3"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:23.975052 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:23.981610 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:23.982065 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:23.982887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:23.983329 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:24.261063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-607c255e-5d3a-4148-865e-a31345b55666 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291331 Jan 14 09:51:24.262324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 408/845] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:51:23 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:51:24.268722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:24.268722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:24.282897 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:24.283342 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:24.285619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:24.286922 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:24.368224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2fb7a9e1-d225-48d6-8010-8a1b768bb672 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/action" status: 202 len: 0 microversion: 2.1 time: 0.615654 Jan 14 09:51:24.369496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 438/846] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:51:23 2022] POST /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:51:24.381125 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-cc6bda62-e5e8-46ab-af7b-19cb166f93e9 req-da0ddd42-6fa0-4f9a-80ed-9adabf2d34aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:24.382872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:51:24.382872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:51:24.408468 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-cc6bda62-e5e8-46ab-af7b-19cb166f93e9 req-da0ddd42-6fa0-4f9a-80ed-9adabf2d34aa service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:24.409310 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-cc6bda62-e5e8-46ab-af7b-19cb166f93e9 req-da0ddd42-6fa0-4f9a-80ed-9adabf2d34aa service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:24.445763 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-cc6bda62-e5e8-46ab-af7b-19cb166f93e9 req-da0ddd42-6fa0-4f9a-80ed-9adabf2d34aa service nova] Creating event network-changed:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:51:24.471517 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-cc6bda62-e5e8-46ab-af7b-19cb166f93e9 req-da0ddd42-6fa0-4f9a-80ed-9adabf2d34aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075754 Jan 14 09:51:24.472444 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 439/847] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:51:24.540679 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:24.549781 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:24.551106 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:24.552833 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b3dc8837-ddf2-4c12-9032-86ea439a4f00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.289004 Jan 14 09:51:24.564083 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 409/848] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:24 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:25.600635 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:25.601487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:25.608853 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:25.609433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:25.610434 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:25.610948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:25.904949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:25.913861 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:25.916541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:25.917724 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fa1e7e27-5dad-4f12-81cf-1555e4d28d47 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.325359 Jan 14 09:51:25.918658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 440/849] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:25 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:51:25.954073 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:25.954713 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:25.961670 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:25.962258 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:25.963086 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:25.963548 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:26.041417 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lazy-loading 'services' on Instance uuid 5f50e468-f662-40b4-a509-b335e26ff3df {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:51:26.110653 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-cc9f1d76-97da-47d0-a0a8-8d0d27f9f337 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments/4cf5b518-02c7-4d19-b691-5b4d250167f9" status: 202 len: 0 microversion: 2.1 time: 0.160097 Jan 14 09:51:26.111694 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 410/850] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:51:25 2022] DELETE /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments/4cf5b518-02c7-4d19-b691-5b4d250167f9 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:51:26.121520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:26.122373 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:26.128940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:26.129555 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:26.130595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:26.131131 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:26.164964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b1025dac-b108-483f-b548-0d907a03d9a8 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Jan 14 09:51:26.165522 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 441/851] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:26 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:26.528264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-fa76dbe6-9b06-4ab6-8399-7fc25af5735c req-66639b15-ed3f-4b90-a946-8fbee1b6c326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:26.529959 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:51:26.529959 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:51:26.538192 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-fa76dbe6-9b06-4ab6-8399-7fc25af5735c req-66639b15-ed3f-4b90-a946-8fbee1b6c326 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:26.539130 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-fa76dbe6-9b06-4ab6-8399-7fc25af5735c req-66639b15-ed3f-4b90-a946-8fbee1b6c326 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:26.551133 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-fa76dbe6-9b06-4ab6-8399-7fc25af5735c req-66639b15-ed3f-4b90-a946-8fbee1b6c326 service nova] Creating event network-changed:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:51:26.557545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-fa76dbe6-9b06-4ab6-8399-7fc25af5735c req-66639b15-ed3f-4b90-a946-8fbee1b6c326 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033309 Jan 14 09:51:26.558430 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 411/852] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:26.728407 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-27da3c9f-a1cd-49d3-9a29-5ba6fa4b0cb0 req-3ad811a4-4d5f-43b3-9a82-5ab4ec8b5209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "name": "network-vif-plugged", "status": "completed", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:26.730889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:51:26.730889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:51:26.740597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-27da3c9f-a1cd-49d3-9a29-5ba6fa4b0cb0 req-3ad811a4-4d5f-43b3-9a82-5ab4ec8b5209 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:26.741176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-27da3c9f-a1cd-49d3-9a29-5ba6fa4b0cb0 req-3ad811a4-4d5f-43b3-9a82-5ab4ec8b5209 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:26.753075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-27da3c9f-a1cd-49d3-9a29-5ba6fa4b0cb0 req-3ad811a4-4d5f-43b3-9a82-5ab4ec8b5209 service nova] Creating event network-vif-plugged:f484129e-42b3-4eed-8bf4-b44de5367943 for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 on hv-cinder-82160 Jan 14 09:51:26.758212 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-27da3c9f-a1cd-49d3-9a29-5ba6fa4b0cb0 req-3ad811a4-4d5f-43b3-9a82-5ab4ec8b5209 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Jan 14 09:51:26.758949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 442/853] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:26.938304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:26.939665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:26.947545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:26.947998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:26.949030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:26.949477 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:27.177179 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:27.178243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:27.189740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:27.190800 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:27.191990 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:27.193335 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:27.238307 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-65a36e1f-78cd-42c6-9ea5-baff9e392d2c tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065473 Jan 14 09:51:27.239200 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 443/854] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:27 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:27.260776 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:27.270013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:27.271855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:27.273391 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7a88991d-955c-4690-b6e0-10a974c1b34b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.339767 Jan 14 09:51:27.273969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 412/855] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:26 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:28.249152 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:28.249975 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:28.257225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:28.257674 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:28.258504 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:28.258944 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:28.288716 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-568414bc-a0f7-4a76-bbb1-ea91ba927876 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Jan 14 09:51:28.289288 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 444/856] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:28 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:28.291347 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:28.292016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:28.298587 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:28.299047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:28.299861 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:28.300307 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:28.451841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:28.462018 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:28.463607 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:28.464775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-70e2d324-c5e4-46be-852f-f79fed0441ba tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1729 microversion: 2.20 time: 0.177466 Jan 14 09:51:28.465496 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 413/857] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:28 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:29.300582 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:29.301606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:29.308518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:29.308973 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:29.309790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:29.310233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:29.354184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5eda85df-2ecb-44b3-8182-b89817908527 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057014 Jan 14 09:51:29.355351 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 445/858] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:29 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:51:29.484101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:29.484708 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:29.491628 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:29.492134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:29.492979 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:29.493425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:29.648697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:29.657095 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:29.658610 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:29.659787 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f8b7a3db-b5e2-4cc0-a422-594afa46a0ca tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1716 microversion: 2.20 time: 0.179629 Jan 14 09:51:29.660354 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 414/859] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:51:29 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1716 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:51:30.369341 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:30.370503 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:30.377125 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:30.377575 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:30.378373 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:30.378814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:30.411487 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-911e6255-00a9-4ab4-a3c7-aacb443ac001 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045850 Jan 14 09:51:30.415395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 446/860] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:30 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:31.425290 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:31.427582 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:31.438514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:31.439127 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:31.440109 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:31.440835 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:31.483844 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-77779ada-73b1-4623-aec2-d8527df07f2b tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064359 Jan 14 09:51:31.484653 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 415/861] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:31 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:31.927335 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:31.928337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:31.940780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:31.941227 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:31.942790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:31.943237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:31.972787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0ccd1144-966d-4e3e-bd2d-bcbe5f365453 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050046 Jan 14 09:51:31.973345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 447/862] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:31 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:31.983033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:31.983580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:31.990037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:31.990515 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:31.991304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:31.991743 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:32.020983 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a4025c01-75a2-43ce-a53f-1350a8378d0c tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/30b363bd-49b3-44fc-895d-7b2d01581ca3" status: 200 len: 194 microversion: 2.1 time: 0.041660 Jan 14 09:51:32.021568 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 416/863] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jan 14 09:51:31 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/30b363bd-49b3-44fc-895d-7b2d01581ca3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:32.496588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:32.497536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:32.503668 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:32.504126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:32.504987 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:32.506135 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:32.538403 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4db0dc06-4930-4c82-b3d5-ca724b0017a1 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045701 Jan 14 09:51:32.538993 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 448/864] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:32 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:51:32.549595 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:32.550196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:32.557222 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:32.557676 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:32.558608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:32.559093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:32.638322 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] HTTP exception thrown: Instance 5f50e468-f662-40b4-a509-b335e26ff3df is not attached to volume 4cf5b518-02c7-4d19-b691-5b4d250167f9 Jan 14 09:51:32.638867 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Returning 404 to user: Instance 5f50e468-f662-40b4-a509-b335e26ff3df is not attached to volume 4cf5b518-02c7-4d19-b691-5b4d250167f9 {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:51:32.639730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-943b17ff-12ea-40dd-9370-4c0759d41f81 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments/4cf5b518-02c7-4d19-b691-5b4d250167f9" status: 404 len: 154 microversion: 2.1 time: 0.094290 Jan 14 09:51:32.640275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 417/865] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:51:32 2022] DELETE /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df/os-volume_attachments/4cf5b518-02c7-4d19-b691-5b4d250167f9 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:51:33.331537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad9ae192-1b00-47e3-8622-e34dab39d735"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:33.332547 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:33.338787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:33.339237 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:33.340013 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:33.340453 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:33.597733 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0750af98-1831-44e1-9630-87b1f796d349 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269841 Jan 14 09:51:33.598596 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 449/866] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:51:33 2022] POST /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:33.784881 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:33.785513 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:33.792304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:33.792755 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:33.793549 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:33.793989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:33.819939 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:51:33.903490 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-346584b9-da02-4d8d-98a1-53d8b91390ec tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 204 len: 0 microversion: 2.1 time: 0.120287 Jan 14 09:51:33.904560 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 418/867] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:51:33 2022] DELETE /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:51:33.913944 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:33.914669 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:33.922135 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:33.923224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:33.923377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:33.923811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:34.065738 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:34.073151 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-da2f6a08-92ba-45d2-b2d0-10a32b60f345 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1554 microversion: 2.1 time: 0.164046 Jan 14 09:51:34.073849 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 450/868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:51:33 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:51:35.092483 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:35.093093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:35.100341 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:35.100786 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:35.101569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:35.102003 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:35.233646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:35.241097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9062ef3f-bf79-4c32-a673-9e2b73390794 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1554 microversion: 2.1 time: 0.152960 Jan 14 09:51:35.241680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 419/869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:51:35 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:51:36.259077 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:36.259705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:36.266411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:36.266870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:36.268975 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:36.269415 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:36.356810 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6d1bf2310b4ecda782c3d56e51c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4768eb3469474c1a8a697727bc0026af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:51:36.369743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-81467006-21d9-4305-b665-e77c9b2445b3 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 200 len: 1512 microversion: 2.1 time: 0.113880 Jan 14 09:51:36.371254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 451/870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:51:36 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 1512 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:51:36.459159 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-eb559e1a-59bf-47a2-a413-7f438f5bea9b req-b6d51bee-332d-44ad-86ef-54b0239cc3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f50e468-f662-40b4-a509-b335e26ff3df", "name": "network-vif-deleted", "tag": "a8c563c3-b40e-4151-8a9f-8712800674f9"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:36.460757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:51:36.460757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:51:36.468044 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-eb559e1a-59bf-47a2-a413-7f438f5bea9b req-b6d51bee-332d-44ad-86ef-54b0239cc3a5 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:36.468491 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-eb559e1a-59bf-47a2-a413-7f438f5bea9b req-b6d51bee-332d-44ad-86ef-54b0239cc3a5 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:36.480482 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-eb559e1a-59bf-47a2-a413-7f438f5bea9b req-b6d51bee-332d-44ad-86ef-54b0239cc3a5 service nova] Creating event network-vif-deleted:a8c563c3-b40e-4151-8a9f-8712800674f9 for instance 5f50e468-f662-40b4-a509-b335e26ff3df on hv-cinder-82160 Jan 14 09:51:36.485411 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-eb559e1a-59bf-47a2-a413-7f438f5bea9b req-b6d51bee-332d-44ad-86ef-54b0239cc3a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191173 Jan 14 09:51:36.485846 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 420/871] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:51:37.386460 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:37.387854 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] [instance: 5f50e468-f662-40b4-a509-b335e26ff3df] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:37.393426 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:37.393876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:37.394689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:37.395161 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:37.409220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] HTTP exception thrown: Instance 5f50e468-f662-40b4-a509-b335e26ff3df could not be found. Jan 14 09:51:37.409813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Returning 404 to user: Instance 5f50e468-f662-40b4-a509-b335e26ff3df could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:51:37.411226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a872c715-bf4f-48d5-b752-cf4569c8b183 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df" status: 404 len: 111 microversion: 2.1 time: 0.027914 Jan 14 09:51:37.411786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 452/872] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:51:37 2022] GET /compute/v2.1/servers/5f50e468-f662-40b4-a509-b335e26ff3df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:51:37.421207 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-96e83c71-8529-48d3-b9e1-e21b5cdfe129 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] Calling method '.version_select at 0x7fd322bdb5e0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:37.440143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-96e83c71-8529-48d3-b9e1-e21b5cdfe129 tempest-TestMinimumBasicScenario-1761060568 tempest-TestMinimumBasicScenario-1761060568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231745446" status: 202 len: 0 microversion: 2.1 time: 0.023478 Jan 14 09:51:37.440732 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 421/873] 10.222.0.48 () {58 vars in 1268 bytes} [Fri Jan 14 09:51:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231745446 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:51:41.085794 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:41.086806 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:41.093400 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:41.093855 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:41.094687 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:41.095133 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:41.126786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cf5fd808-7ad1-487a-bbaa-2e4ee80e68f2 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045197 Jan 14 09:51:41.127505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 453/874] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:41 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:55.712363 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-35498f54-cd47-4c83-9b24-0bb591f391b4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Action: 'create', calling method: .version_select at 0x7fd322ae58b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-524938077"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:51:55.734601 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-35498f54-cd47-4c83-9b24-0bb591f391b4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Getting quotas for project eac278870baf47c3b45b81d7e509466a. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:51:55.739194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-35498f54-cd47-4c83-9b24-0bb591f391b4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Getting quotas for user 3a77fc06f8ee40e3aec78fa5e7caf672 and project eac278870baf47c3b45b81d7e509466a. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:51:56.258564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-35498f54-cd47-4c83-9b24-0bb591f391b4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Getting quotas for project eac278870baf47c3b45b81d7e509466a. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:51:56.262373 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-35498f54-cd47-4c83-9b24-0bb591f391b4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Getting quotas for user 3a77fc06f8ee40e3aec78fa5e7caf672 and project eac278870baf47c3b45b81d7e509466a. Resources: {'key_pairs'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:51:56.276613 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-35498f54-cd47-4c83-9b24-0bb591f391b4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.769544 Jan 14 09:51:56.277003 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 422/875] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Jan 14 09:51:55 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:51:56.774478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:56.775031 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:56.783596 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:56.783942 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:56.784788 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:56.785191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:56.823964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-99b17f4a-1e83-42fd-8a2a-4ec31c744a3e tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/30b363bd-49b3-44fc-895d-7b2d01581ca3" status: 200 len: 194 microversion: 2.1 time: 0.053479 Jan 14 09:51:56.824991 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 454/876] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jan 14 09:51:56 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/30b363bd-49b3-44fc-895d-7b2d01581ca3 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:56.834661 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:56.835417 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:56.843996 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:56.844877 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:56.845848 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:56.846572 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:56.932216 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lazy-loading 'services' on Instance uuid c2e7fc55-1db6-4690-91fe-b670f423d724 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:51:57.040742 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5d8349c2-3128-4e0d-b762-bed49482eeb3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/30b363bd-49b3-44fc-895d-7b2d01581ca3" status: 202 len: 0 microversion: 2.1 time: 0.209703 Jan 14 09:51:57.041837 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 423/877] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:51:56 2022] DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/30b363bd-49b3-44fc-895d-7b2d01581ca3 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:51:58.177625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:58.178241 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:58.187857 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:58.188719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:58.189544 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:58.191433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:58.225096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a95a42eb-c1cd-4a9c-bcf3-8473f05f40a6 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/ad9ae192-1b00-47e3-8622-e34dab39d735" status: 200 len: 194 microversion: 2.1 time: 0.051784 Jan 14 09:51:58.225934 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 455/878] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jan 14 09:51:58 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/ad9ae192-1b00-47e3-8622-e34dab39d735 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:51:58.236483 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:58.237248 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:58.244533 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:58.244976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:58.245762 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:58.246195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:58.330763 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lazy-loading 'services' on Instance uuid c2e7fc55-1db6-4690-91fe-b670f423d724 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:51:58.407730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ba313ac8-f5fa-44c5-aac9-f30128230a63 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/ad9ae192-1b00-47e3-8622-e34dab39d735" status: 202 len: 0 microversion: 2.1 time: 0.175703 Jan 14 09:51:58.408307 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 424/879] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:51:58 2022] DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments/ad9ae192-1b00-47e3-8622-e34dab39d735 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:51:59.654420 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:59.655341 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:59.662102 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:59.662598 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:59.663599 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:59.664243 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:59.709438 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a13c5327-b274-425b-875e-154de29631a0 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058278 Jan 14 09:51:59.710704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 456/880] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:59 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:51:59.822018 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:59.823115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:59.833880 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:59.834564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:59.835377 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:59.836003 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:59.891006 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7a42caf5-0cc6-4aa4-a39d-43cc288a34c7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072602 Jan 14 09:51:59.893455 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 425/881] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:51:59 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:51:59.959719 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:51:59.960437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:51:59.970210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:59.970989 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:59.972003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:51:59.972611 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:51:59.999888 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:52:00.098513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d4f4aaad-adfa-4e43-9146-5ce491bf2fd3 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 204 len: 0 microversion: 2.1 time: 0.142619 Jan 14 09:52:00.102673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 457/882] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:51:59 2022] DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:52:00.110636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:00.111264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:00.120228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:00.120693 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:00.121706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:00.122337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:00.284318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:00.292750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aa206038-6df7-46a9-b6db-2b7af3c55394 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1673 microversion: 2.1 time: 0.188278 Jan 14 09:52:00.293332 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 426/883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:00 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:01.310245 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:01.310986 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:01.318255 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:01.318743 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:01.319536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:01.319972 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:01.457839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:01.468089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-148dc88b-e3a4-40c2-97c1-9bf67107c869 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1673 microversion: 2.1 time: 0.162047 Jan 14 09:52:01.468672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 458/884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:01 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:02.485274 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:02.486066 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:02.492841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:02.493297 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:02.494114 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:02.494778 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:02.971191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:02.972664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:02.986471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:02.987244 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:02.988804 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:02.989470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:03.021057 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b960f20a01149e192c66b63f828c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bf1f42e4b4e9c8453d4c7a44f8a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:03.022315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-61a2d582-b242-4cab-b095-fb343826df7b tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055387 Jan 14 09:52:03.022999 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 459/885] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jan 14 09:52:02 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:03.038772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c9735d21-8ef6-4221-8d39-67ae54ee9398 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 200 len: 1673 microversion: 2.1 time: 0.556190 Jan 14 09:52:03.041482 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 427/886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:02 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 1673 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:03.089449 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:03.090105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:03.096362 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:03.097478 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:03.098381 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:03.098921 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:03.125592 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:52:03.218141 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4e8f2629-9c75-4890-9663-6a0d241aaaf4 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 204 len: 0 microversion: 2.20 time: 0.131905 Jan 14 09:52:03.226771 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 460/887] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jan 14 09:52:03 2022] DELETE /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 14 09:52:03.228577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:03.229179 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:03.235337 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:03.235908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:03.236899 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:03.238093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:03.322341 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-ed7c81d0-e12e-4974-8fda-246c69fa31af req-642fc2fa-184f-4d70-a19b-2bffc02a4891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e7fc55-1db6-4690-91fe-b670f423d724", "name": "network-vif-deleted", "tag": "dc36e5cb-1909-4c3c-96b7-4a056ca07482"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:03.324069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:03.324069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:52:03.337547 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-ed7c81d0-e12e-4974-8fda-246c69fa31af req-642fc2fa-184f-4d70-a19b-2bffc02a4891 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:03.338073 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-ed7c81d0-e12e-4974-8fda-246c69fa31af req-642fc2fa-184f-4d70-a19b-2bffc02a4891 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:03.370707 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-ed7c81d0-e12e-4974-8fda-246c69fa31af req-642fc2fa-184f-4d70-a19b-2bffc02a4891 service nova] Creating event network-vif-deleted:dc36e5cb-1909-4c3c-96b7-4a056ca07482 for instance c2e7fc55-1db6-4690-91fe-b670f423d724 on hv-cinder-82160 Jan 14 09:52:03.378832 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-ed7c81d0-e12e-4974-8fda-246c69fa31af req-642fc2fa-184f-4d70-a19b-2bffc02a4891 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059601 Jan 14 09:52:03.380317 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 461/888] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:03.493965 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:03.505153 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:03.507088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:03.508514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-720a56f4-828e-49c5-80a2-8e72d612cc13 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.284200 Jan 14 09:52:03.519935 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 428/889] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:52:03 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:52:04.058231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:04.059691 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:04.066814 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:04.067269 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:04.068067 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:04.068507 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:04.081893 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] HTTP exception thrown: Instance c2e7fc55-1db6-4690-91fe-b670f423d724 could not be found. Jan 14 09:52:04.082527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Returning 404 to user: Instance c2e7fc55-1db6-4690-91fe-b670f423d724 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:04.083356 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0c1b4afd-0cf8-424c-b4c0-750dd0c50f72 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 404 len: 111 microversion: 2.1 time: 0.030033 Jan 14 09:52:04.084063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 462/890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:04 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:52:04.091991 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5f44b9af-b36b-42e3-a875-e4ee1724f5b7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '.version_select at 0x7fd322c39e50>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:04.118654 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5f44b9af-b36b-42e3-a875-e4ee1724f5b7 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362527876" status: 202 len: 0 microversion: 2.1 time: 0.030140 Jan 14 09:52:04.119525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 429/891] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jan 14 09:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362527876 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:52:04.528153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:04.529041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:04.536518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:04.536979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:04.537770 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:04.538414 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:04.696285 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:04.708693 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:04.710197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:04.711589 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1f29ebbd-a173-4c70-bd3c-5bd43196b0bd tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1722 microversion: 2.20 time: 0.187713 Jan 14 09:52:04.712375 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 463/892] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:52:04 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 14 09:52:05.670437 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-1bc56df8-512c-446e-b225-dd98b3729b4e req-6b48ab16-7bfb-4af7-a871-c64347867ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db101fb-52af-4565-b50f-e4b0ca94ad18", "name": "network-vif-deleted", "tag": "f484129e-42b3-4eed-8bf4-b44de5367943"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:05.672134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:05.672134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:05.681033 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-1bc56df8-512c-446e-b225-dd98b3729b4e req-6b48ab16-7bfb-4af7-a871-c64347867ae9 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:05.687010 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-1bc56df8-512c-446e-b225-dd98b3729b4e req-6b48ab16-7bfb-4af7-a871-c64347867ae9 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:05.694368 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-1bc56df8-512c-446e-b225-dd98b3729b4e req-6b48ab16-7bfb-4af7-a871-c64347867ae9 service nova] Creating event network-vif-deleted:f484129e-42b3-4eed-8bf4-b44de5367943 for instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 on hv-cinder-82160 Jan 14 09:52:05.699464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-1bc56df8-512c-446e-b225-dd98b3729b4e req-6b48ab16-7bfb-4af7-a871-c64347867ae9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032757 Jan 14 09:52:05.700174 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 430/893] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:05.736180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:05.737034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:05.745553 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:05.746735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:05.747843 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:05.749135 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:05.819416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:05.829780 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:05.831695 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d5195514db043518c76df657c40baa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87879779a7049fa888526ce5a0bf552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:05.833068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9980f84d-5edb-47ad-bb61-990cf6919075 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 200 len: 1365 microversion: 2.20 time: 0.105883 Jan 14 09:52:05.833718 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 464/894] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:52:05 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 14 09:52:06.853030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:06.853718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:06.859944 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:06.860389 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:06.861167 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:06.861608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:06.874931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] HTTP exception thrown: Instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 could not be found. Jan 14 09:52:06.875519 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Returning 404 to user: Instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:06.876334 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ef556add-14ad-4964-96aa-4207a7da110f tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 404 len: 111 microversion: 2.20 time: 0.027874 Jan 14 09:52:06.876893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 431/895] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:52:06 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:52:06.885715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-eb74694d-b625-44a4-8ae3-c6f3a2c24a5e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '.version_select at 0x7fd327621790>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:06.906374 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-eb74694d-b625-44a4-8ae3-c6f3a2c24a5e tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81716715" status: 204 len: 0 microversion: 2.20 time: 0.024241 Jan 14 09:52:06.906959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 465/896] 10.222.0.48 () {60 vars in 1255 bytes} [Fri Jan 14 09:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81716715 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 14 09:52:07.208730 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:07.210164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:07.217279 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:07.217912 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:07.218888 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:07.219486 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:07.244122 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] HTTP exception thrown: Instance c2e7fc55-1db6-4690-91fe-b670f423d724 could not be found. Jan 14 09:52:07.245857 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Returning 404 to user: Instance c2e7fc55-1db6-4690-91fe-b670f423d724 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:07.246981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2606cafb-d791-4805-a013-09e6532fc1bc tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 404 len: 111 microversion: 2.1 time: 0.043400 Jan 14 09:52:07.247690 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 432/897] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:52:07 2022] DELETE /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:52:07.255399 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:07.256277 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: c2e7fc55-1db6-4690-91fe-b670f423d724] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:07.262259 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:07.262873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:07.263561 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:07.264002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:07.280790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] HTTP exception thrown: Instance c2e7fc55-1db6-4690-91fe-b670f423d724 could not be found. Jan 14 09:52:07.281845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Returning 404 to user: Instance c2e7fc55-1db6-4690-91fe-b670f423d724 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:07.282980 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8a33c89e-2c88-45bb-8d6c-28bee362a966 tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724" status: 404 len: 111 microversion: 2.1 time: 0.031313 Jan 14 09:52:07.283978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 466/898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:07 2022] GET /compute/v2.1/servers/c2e7fc55-1db6-4690-91fe-b670f423d724 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:52:08.418544 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:08.419040 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:08.425238 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.425706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.426575 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.427013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.440051 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] HTTP exception thrown: Instance 280d074f-8581-4736-a953-d93b0e2f6c6d could not be found. Jan 14 09:52:08.441138 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Returning 404 to user: Instance 280d074f-8581-4736-a953-d93b0e2f6c6d could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:08.441951 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1e913f65-0834-4ed5-9da3-bbaaba9359ac tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 404 len: 111 microversion: 2.1 time: 0.027153 Jan 14 09:52:08.442509 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 433/899] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:52:08 2022] DELETE /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:52:08.450160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:08.450790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] [instance: 280d074f-8581-4736-a953-d93b0e2f6c6d] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:08.457677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.458122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.458919 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.459351 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.472261 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] HTTP exception thrown: Instance 280d074f-8581-4736-a953-d93b0e2f6c6d could not be found. Jan 14 09:52:08.472831 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] Returning 404 to user: Instance 280d074f-8581-4736-a953-d93b0e2f6c6d could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:08.473667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cba55e46-7bae-49ab-a443-6451af63c04f tempest-AttachVolumeTestJSON-79572631 tempest-AttachVolumeTestJSON-79572631-project] 10.222.0.48 "GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d" status: 404 len: 111 microversion: 2.1 time: 0.027164 Jan 14 09:52:08.474205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 467/900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:08 2022] GET /compute/v2.1/servers/280d074f-8581-4736-a953-d93b0e2f6c6d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:52:08.716469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:08.717001 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:08.722819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.723385 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.724165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.724598 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.738311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] HTTP exception thrown: Instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 could not be found. Jan 14 09:52:08.738927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Returning 404 to user: Instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:08.739750 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ad50ba01-e594-4d75-9afb-889d82b83892 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 404 len: 111 microversion: 2.20 time: 0.026964 Jan 14 09:52:08.740300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 434/901] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jan 14 09:52:08 2022] DELETE /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:52:08.748204 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:08.748900 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: 0db101fb-52af-4565-b50f-e4b0ca94ad18] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:08.755475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.755929 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.756711 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:08.757150 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:08.770255 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] HTTP exception thrown: Instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 could not be found. Jan 14 09:52:08.770869 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Returning 404 to user: Instance 0db101fb-52af-4565-b50f-e4b0ca94ad18 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:08.771689 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-43384994-e2f1-49c9-ac58-a9124a2fe5bf tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18" status: 404 len: 111 microversion: 2.20 time: 0.027222 Jan 14 09:52:08.772409 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 468/902] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:52:08 2022] GET /compute/v2.1/servers/0db101fb-52af-4565-b50f-e4b0ca94ad18 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:52:09.901696 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:09.902186 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:09.908523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:09.908974 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:09.909757 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:09.910192 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:09.923391 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] HTTP exception thrown: Instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a could not be found. Jan 14 09:52:09.923980 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Returning 404 to user: Instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:09.924802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-18f622cf-f571-4e92-a107-f9942b0eaa00 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 404 len: 111 microversion: 2.20 time: 0.026925 Jan 14 09:52:09.925358 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 435/903] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jan 14 09:52:09 2022] DELETE /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:52:09.934309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:09.934953 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] [instance: a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:09.942155 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:09.942678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:09.943613 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:09.943995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:09.960085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] HTTP exception thrown: Instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a could not be found. Jan 14 09:52:09.960681 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] Returning 404 to user: Instance a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:09.961603 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9644fb64-694e-42bd-a3d8-82dbd319a996 tempest-AttachVolumeShelveTestJSON-1051111764 tempest-AttachVolumeShelveTestJSON-1051111764-project] 10.222.0.48 "GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a" status: 404 len: 111 microversion: 2.20 time: 0.031850 Jan 14 09:52:09.962083 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 469/904] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jan 14 09:52:09 2022] GET /compute/v2.1/servers/a3c0d2d0-f062-4164-a9eb-d4ed87c05c9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:52:12.566588 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-487980952", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-524938077", "security_groups": [{"name": "tempest-secgroup-smoke-1594947697"}], "networks": [{"uuid": "d940145d-2f3f-4b98-813c-0d1310fd77ff"}], "block_device_mapping_v2": [{"uuid": "f7ab2497-18c7-4520-8ad2-96fcd749176a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:12.793414 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] validate_networks() for [('d940145d-2f3f-4b98-813c-0d1310fd77ff', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:52:13.246616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:52:13.246895 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:52:13.247374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:52:13.247813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:52:13.248204 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:52:13.273189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:13.273189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:13.273189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:13.273189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:13.289348 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Getting quotas for project eac278870baf47c3b45b81d7e509466a. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:52:13.293997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Getting quotas for user 3a77fc06f8ee40e3aec78fa5e7caf672 and project eac278870baf47c3b45b81d7e509466a. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:52:13.392182 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:52:13.398936 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7ab2497-18c7-4520-8ad2-96fcd749176a',volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:52:13.587742 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-88200e16-0a91-47d7-88f6-6b2058b23178 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025278 Jan 14 09:52:13.588805 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 436/905] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:52:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:52:13.600909 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-16ea24ff-66f0-4ef7-ad0e-3d8cab2f325d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:13.602217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-16ea24ff-66f0-4ef7-ad0e-3d8cab2f325d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:13.751458 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-16ea24ff-66f0-4ef7-ad0e-3d8cab2f325d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:13.765704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-16ea24ff-66f0-4ef7-ad0e-3d8cab2f325d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1087 microversion: 2.1 time: 0.170350 Jan 14 09:52:13.766282 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 470/906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:13 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1087 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:14.783990 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:14.785287 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:14.792623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:14.794558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:14.797131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:14.805421 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:14.889253 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:14.899097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1b65c393-efe0-4991-ba22-fa7915466719 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1193 microversion: 2.1 time: 0.119529 Jan 14 09:52:14.900058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 437/907] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:14 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1193 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:15.108327 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-663440588", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "746b6838-b16b-4837-950e-306ded637236"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:15.162193 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] validate_networks() for [('746b6838-b16b-4837-950e-306ded637236', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:52:15.732043 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:52:15.732475 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:52:15.732987 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:52:15.733520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:52:15.733981 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:52:15.750999 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:15.751465 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:15.752287 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:15.753331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:15.788641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:52:15.793535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for user f3c8ac9205954f4c80ecf83e0542ee9c and project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:52:15.806836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:52:15.809167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:52:15.863826 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f8158843-ffa1-4025-a1c6-a7161d6532cf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056250 Jan 14 09:52:15.864473 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 471/908] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 14 09:52:15.875224 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ae76aa34-877c-4ba1-9a3d-c01ea0f5289b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:15.876720 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ae76aa34-877c-4ba1-9a3d-c01ea0f5289b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:15.916788 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:15.917411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:15.929012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:15.929457 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:15.930519 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:15.931476 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:15.952941 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ae76aa34-877c-4ba1-9a3d-c01ea0f5289b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:15.968197 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ae76aa34-877c-4ba1-9a3d-c01ea0f5289b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1217 microversion: 2.1 time: 0.096614 Jan 14 09:52:15.968819 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 438/909] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:15 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:52:16.470239 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-f007b79c-038e-4627-976d-4a9270d540ae req-2ccfddb0-dde7-469c-b1fb-3f84cbb636a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:16.473771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:16.473771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:16.490922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:16.494765 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-f007b79c-038e-4627-976d-4a9270d540ae req-2ccfddb0-dde7-469c-b1fb-3f84cbb636a7 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:16.495425 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-f007b79c-038e-4627-976d-4a9270d540ae req-2ccfddb0-dde7-469c-b1fb-3f84cbb636a7 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:16.499270 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5ce773d3-0138-4d62-8ce4-c18f0caff859 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.586265 Jan 14 09:52:16.506588 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 472/910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:15 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:52:16.518477 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-f007b79c-038e-4627-976d-4a9270d540ae req-2ccfddb0-dde7-469c-b1fb-3f84cbb636a7 service nova] Creating event network-changed:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:52:16.523989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-f007b79c-038e-4627-976d-4a9270d540ae req-2ccfddb0-dde7-469c-b1fb-3f84cbb636a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058361 Jan 14 09:52:16.526161 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 439/911] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:16.984670 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:16.985498 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:16.992521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:16.992974 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:16.993777 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:16.994213 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:17.061827 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:17.069838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-29190b1e-7c02-4773-bc28-33b7e2c61661 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1269 microversion: 2.1 time: 0.088825 Jan 14 09:52:17.070441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 473/912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:16 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:17.517304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:17.518770 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:17.524765 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:17.525223 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:17.526018 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:17.526487 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:17.936850 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:17.944374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c2d0bb9f-adcf-45bd-bed0-a3c5147c4a31 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.431576 Jan 14 09:52:17.954185 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 440/913] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:17 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:18.087546 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:18.088278 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:18.097748 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:18.098400 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:18.099292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:18.099708 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:18.166552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:18.173876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8c90616b-d1c6-4f5a-a148-f31b961b58f8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1275 microversion: 2.1 time: 0.090730 Jan 14 09:52:18.175043 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 474/914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:18 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:18.961725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:18.962940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:18.970265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:18.971618 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:18.973371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:18.974087 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:19.191194 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:19.192323 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:19.198908 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:19.199721 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:19.200740 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:19.201591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:19.204034 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:19.215200 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-930ac078-96ef-45e4-81df-5021b09bce82 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.257623 Jan 14 09:52:19.216500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 441/915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:18 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:19.309241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-055ef645-602c-4d2b-8f9d-627edc71499b req-1df5fc58-212b-4813-a5cc-03469f964258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3124eb0-d33a-41bb-b18b-606e0e817e81", "tag": "feb71080-4f0e-4bf7-99ba-b7cb1b3e3332"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:19.330840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:19.330840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:19.354152 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-055ef645-602c-4d2b-8f9d-627edc71499b req-1df5fc58-212b-4813-a5cc-03469f964258 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:19.354704 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-055ef645-602c-4d2b-8f9d-627edc71499b req-1df5fc58-212b-4813-a5cc-03469f964258 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:19.372816 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:19.375484 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-055ef645-602c-4d2b-8f9d-627edc71499b req-1df5fc58-212b-4813-a5cc-03469f964258 service nova] Creating event network-changed:feb71080-4f0e-4bf7-99ba-b7cb1b3e3332 for instance d3124eb0-d33a-41bb-b18b-606e0e817e81 on hv-cinder-82160 Jan 14 09:52:19.382030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-540e8b4f-08a8-4566-8b31-dc79531675bf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1317 microversion: 2.1 time: 0.195043 Jan 14 09:52:19.391654 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 475/916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:19 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:52:19.392398 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-055ef645-602c-4d2b-8f9d-627edc71499b req-1df5fc58-212b-4813-a5cc-03469f964258 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088738 Jan 14 09:52:19.392398 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 442/917] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:20.232057 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:20.232758 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:20.240217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:20.240217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:20.240974 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:20.241413 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:20.387332 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:20.396210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7d16c325-f702-4ca9-894b-b3d8d4677ef0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.167809 Jan 14 09:52:20.396811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 476/918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:20 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:20.400633 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:20.401329 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:20.408232 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:20.408701 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:20.409622 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:20.410075 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:20.541399 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:20.548788 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-438fe7f0-5421-4f26-936a-2cb24cefc136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1317 microversion: 2.1 time: 0.152521 Jan 14 09:52:20.549852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 443/919] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:20 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:21.413412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:21.414049 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:21.420389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:21.420839 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:21.421614 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:21.422051 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:21.563144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:21.565319 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:21.566491 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:21.570844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-acaa52dd-2511-4cbe-97d9-99736ad6a0e6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.160745 Jan 14 09:52:21.571575 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 477/920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:21 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:21.581866 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:21.582324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:21.583148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:21.583597 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:21.713748 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:21.722901 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7ba8edd3-974d-4617-993b-6002beed6efe tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1317 microversion: 2.1 time: 0.161138 Jan 14 09:52:21.723488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 444/921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:21 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:22.587456 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:22.588521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:22.594210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:22.594683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:22.595462 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:22.595904 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:22.726769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:22.734010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9d488539-79a1-478a-8888-e0be3ae47cc4 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.150204 Jan 14 09:52:22.739595 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:22.740203 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:22.743620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 478/922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:22 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:22.747039 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:22.747477 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:22.748271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:22.748705 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:22.902708 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:22.915000 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ac9e7758-71f5-4247-806e-30d7a8b90ed2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1317 microversion: 2.1 time: 0.179183 Jan 14 09:52:22.915788 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 445/923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:22 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:23.758836 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:23.759446 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:23.765591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:23.766253 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:23.767058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:23.767488 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:23.904984 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:23.913002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f9661b4a-3903-4d94-a383-e10a05b7088a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.157574 Jan 14 09:52:23.913597 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 479/924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:23 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:23.932799 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:23.933495 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:23.940767 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:23.941518 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:23.942646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:23.943246 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:24.072951 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:24.083664 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-57de4434-b977-4033-9e57-7942749f326a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1317 microversion: 2.1 time: 0.155144 Jan 14 09:52:24.084360 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 446/925] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:23 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:24.931178 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:24.931784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:24.941100 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:24.941552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:24.943845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:24.943845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:24.976681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-4aef56ef-1612-471b-b4be-111e3be97468 req-a01147a1-d678-43ec-8baf-449bb4e86353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3124eb0-d33a-41bb-b18b-606e0e817e81", "name": "network-vif-plugged", "status": "completed", "tag": "feb71080-4f0e-4bf7-99ba-b7cb1b3e3332"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:24.980142 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:24.980142 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:24.991542 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-4aef56ef-1612-471b-b4be-111e3be97468 req-a01147a1-d678-43ec-8baf-449bb4e86353 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:24.992160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-4aef56ef-1612-471b-b4be-111e3be97468 req-a01147a1-d678-43ec-8baf-449bb4e86353 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:25.012094 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-4aef56ef-1612-471b-b4be-111e3be97468 req-a01147a1-d678-43ec-8baf-449bb4e86353 service nova] Creating event network-vif-plugged:feb71080-4f0e-4bf7-99ba-b7cb1b3e3332 for instance d3124eb0-d33a-41bb-b18b-606e0e817e81 on hv-cinder-82160 Jan 14 09:52:25.018725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-4aef56ef-1612-471b-b4be-111e3be97468 req-a01147a1-d678-43ec-8baf-449bb4e86353 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047394 Jan 14 09:52:25.020189 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 447/926] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:52:25.100892 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:25.104321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:25.105408 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:25.108717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-dcf81283-38d4-453d-8a0f-c0bca82ab218 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.182096 Jan 14 09:52:25.113429 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:25.114605 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:25.115719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:25.116478 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:25.119471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 480/927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:24 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:25.328265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:25.337186 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-608e6a90-91f8-48b2-95b6-4736553c3d6b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1317 microversion: 2.1 time: 0.237884 Jan 14 09:52:25.337800 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 448/928] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:25 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:26.126450 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:26.127088 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:26.133304 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:26.133757 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:26.134577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:26.135050 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:26.280570 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:26.288924 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-088943ae-1fcf-4f32-92ae-1c74b86051ed tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.166039 Jan 14 09:52:26.289660 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 481/929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:26 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:26.353031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:26.353644 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:26.362940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:26.362940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:26.363504 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:26.363943 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:26.504624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:26.511918 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3ad1dfd4-3cfb-4332-a9ea-562b54d8c271 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1507 microversion: 2.1 time: 0.162677 Jan 14 09:52:26.512481 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 449/930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:26 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:27.036454 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-b509338d-ef71-44d3-af01-1888c5aa4476 req-433a9964-7da0-4ed5-a31b-707312300a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "name": "network-vif-plugged", "status": "completed", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:27.038622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:27.038622 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:52:27.045365 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-b509338d-ef71-44d3-af01-1888c5aa4476 req-433a9964-7da0-4ed5-a31b-707312300a1e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:27.045813 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-b509338d-ef71-44d3-af01-1888c5aa4476 req-433a9964-7da0-4ed5-a31b-707312300a1e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:27.057847 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-b509338d-ef71-44d3-af01-1888c5aa4476 req-433a9964-7da0-4ed5-a31b-707312300a1e service nova] Creating event network-vif-plugged:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:52:27.063026 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-b509338d-ef71-44d3-af01-1888c5aa4476 req-433a9964-7da0-4ed5-a31b-707312300a1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Jan 14 09:52:27.067079 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 482/931] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:52:27.305767 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:27.306986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:27.313047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:27.313426 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:27.314278 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:27.315299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:27.458299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:27.466058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-cc665800-2335-4d4c-bd84-227f14f2dd96 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1259 microversion: 2.1 time: 0.164265 Jan 14 09:52:27.466673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 450/932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:27 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:27.904523 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "deb290b6-8ddd-4121-b74b-02747c73ed29"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:27.905844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:27.912667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:27.913117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:27.913904 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:27.914337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:28.161438 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e0199498-29b9-4f24-85ef-2912f3ce3c50 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261130 Jan 14 09:52:28.162052 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 483/933] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:52:27 2022] POST /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:52:28.483540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:28.484169 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:28.491310 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:28.491953 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:28.492740 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:28.493167 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:28.642705 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:28.650284 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a5b0f259-d645-4462-b283-2fa1decf36d7 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1443 microversion: 2.1 time: 0.170357 Jan 14 09:52:28.650879 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 451/934] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:28 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:28.667377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:28.668069 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:28.675736 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:28.676226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:28.677014 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:28.677451 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:28.817472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:28.826091 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f84cdfd4-d414-4c78-9143-1326666a531c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1443 microversion: 2.1 time: 0.163326 Jan 14 09:52:28.826705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 484/935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:28 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:30.688459 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-60c6acc3-0aec-4a7c-aee7-e27d503a6dec req-5ad432f9-06f8-4a80-b0dc-19785b7558b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:30.690102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:30.690102 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:30.697098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-60c6acc3-0aec-4a7c-aee7-e27d503a6dec req-5ad432f9-06f8-4a80-b0dc-19785b7558b4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:30.697525 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-60c6acc3-0aec-4a7c-aee7-e27d503a6dec req-5ad432f9-06f8-4a80-b0dc-19785b7558b4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:30.714076 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-60c6acc3-0aec-4a7c-aee7-e27d503a6dec req-5ad432f9-06f8-4a80-b0dc-19785b7558b4 service nova] Creating event network-changed:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:52:30.723037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-60c6acc3-0aec-4a7c-aee7-e27d503a6dec req-5ad432f9-06f8-4a80-b0dc-19785b7558b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038006 Jan 14 09:52:30.723887 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 452/936] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:52:34.691710 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-943325199", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "746b6838-b16b-4837-950e-306ded637236"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:34.745021 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] validate_networks() for [('746b6838-b16b-4837-950e-306ded637236', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:52:35.120895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:52:35.121337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:52:35.121811 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:52:35.122220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:52:35.122673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:52:35.132331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:35.132774 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:35.133593 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:35.134028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:35.151343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:52:35.155273 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for user f3c8ac9205954f4c80ecf83e0542ee9c and project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:52:35.167112 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:52:35.169429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:52:35.217677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1491a075-e670-4718-a559-c01e77f8918d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530113 Jan 14 09:52:35.218526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 485/937] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:52:35.230183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-459ef35a-3f59-4e63-9f23-e8474ccfd94a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:35.230950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-459ef35a-3f59-4e63-9f23-e8474ccfd94a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:35.295321 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-459ef35a-3f59-4e63-9f23-e8474ccfd94a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:35.302072 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-459ef35a-3f59-4e63-9f23-e8474ccfd94a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1217 microversion: 2.1 time: 0.076914 Jan 14 09:52:35.302702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 453/938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:35 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:36.322342 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:36.323580 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:36.330852 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:36.331579 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:36.332577 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:36.333196 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:36.406201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:36.414959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-611efca7-3584-4ba2-9e44-0f8f57737783 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1275 microversion: 2.1 time: 0.098090 Jan 14 09:52:36.415796 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 486/939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:36 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:37.432027 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:37.432740 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:37.440300 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:37.440753 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:37.441714 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:37.442194 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:37.622312 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-a212494d-74d1-4898-9dc4-438573fa0cf1 req-ceab0f23-be6f-4263-b4a7-a709e37c28a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1feb26-e8a4-4db8-b792-62b82c6b91d7", "tag": "fb0fba0e-6ee7-4e18-8a0b-0bbd0399a47d"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:37.624326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:37.624326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:52:37.640364 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-a212494d-74d1-4898-9dc4-438573fa0cf1 req-ceab0f23-be6f-4263-b4a7-a709e37c28a8 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:37.641195 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-a212494d-74d1-4898-9dc4-438573fa0cf1 req-ceab0f23-be6f-4263-b4a7-a709e37c28a8 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:37.653566 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-a212494d-74d1-4898-9dc4-438573fa0cf1 req-ceab0f23-be6f-4263-b4a7-a709e37c28a8 service nova] Creating event network-changed:fb0fba0e-6ee7-4e18-8a0b-0bbd0399a47d for instance 2d1feb26-e8a4-4db8-b792-62b82c6b91d7 on hv-cinder-82160 Jan 14 09:52:37.659982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-a212494d-74d1-4898-9dc4-438573fa0cf1 req-ceab0f23-be6f-4263-b4a7-a709e37c28a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042156 Jan 14 09:52:37.661180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 487/940] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:37.694338 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:37.702297 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-068dac88-159d-4d58-b413-a4539b25ba87 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1317 microversion: 2.1 time: 0.274258 Jan 14 09:52:37.702927 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 454/941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:37 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:38.719109 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:38.719762 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:38.726641 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:38.727101 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:38.728043 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:38.728606 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:38.869017 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:38.876219 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b51c1d56-f5ad-486b-a165-e58729f5cc08 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1317 microversion: 2.1 time: 0.161163 Jan 14 09:52:38.876785 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 488/942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:38 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:39.894212 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:39.894873 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:39.902844 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:39.903299 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:39.904103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:39.904544 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:40.039623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:40.047704 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aaa66fdf-3312-434b-a4b4-7e6da2a10b4d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1317 microversion: 2.1 time: 0.158366 Jan 14 09:52:40.048280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 455/943] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:39 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:41.064260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:41.064949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:41.071316 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:41.071770 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:41.072552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:41.072994 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:41.212576 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:41.221704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c1585e12-79de-4aaf-a284-89d8afa116ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1317 microversion: 2.1 time: 0.159731 Jan 14 09:52:41.221704 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 489/944] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:41 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:42.237569 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:42.238259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:42.244548 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:42.244998 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:42.245782 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:42.246226 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:42.380875 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:42.388365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-b4aaa492-20cb-43f7-99ef-84c13989ed57 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1317 microversion: 2.1 time: 0.154731 Jan 14 09:52:42.388932 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 456/945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:42 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:42.892105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-c5a37789-d474-481c-8818-bb9c5aa558e2 req-b3381a30-2ce1-4de4-9c5d-7e1c9ed0ed95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1feb26-e8a4-4db8-b792-62b82c6b91d7", "name": "network-vif-plugged", "status": "completed", "tag": "fb0fba0e-6ee7-4e18-8a0b-0bbd0399a47d"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:42.893640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:42.893640 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:52:42.902112 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c5a37789-d474-481c-8818-bb9c5aa558e2 req-b3381a30-2ce1-4de4-9c5d-7e1c9ed0ed95 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:42.902697 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c5a37789-d474-481c-8818-bb9c5aa558e2 req-b3381a30-2ce1-4de4-9c5d-7e1c9ed0ed95 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:42.918330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-c5a37789-d474-481c-8818-bb9c5aa558e2 req-b3381a30-2ce1-4de4-9c5d-7e1c9ed0ed95 service nova] Creating event network-vif-plugged:fb0fba0e-6ee7-4e18-8a0b-0bbd0399a47d for instance 2d1feb26-e8a4-4db8-b792-62b82c6b91d7 on hv-cinder-82160 Jan 14 09:52:42.923661 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-c5a37789-d474-481c-8818-bb9c5aa558e2 req-b3381a30-2ce1-4de4-9c5d-7e1c9ed0ed95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034878 Jan 14 09:52:42.924930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 490/946] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:52:43.405138 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:43.406339 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:43.414093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:43.414585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:43.415371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:43.415803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:43.554412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:43.561773 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-67017de6-472b-4e4a-8125-c9530e59f10b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1317 microversion: 2.1 time: 0.160315 Jan 14 09:52:43.562327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 457/947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:43 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:44.580861 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:44.582192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:44.588945 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:44.589417 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:44.590232 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:44.590708 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:44.725964 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:44.733516 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-ddfa5884-6488-40f7-a99c-fee34c8b5da9 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1507 microversion: 2.1 time: 0.156632 Jan 14 09:52:44.734096 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 491/948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:44 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:44.749798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "deb290b6-8ddd-4121-b74b-02747c73ed29"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:44.750884 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:44.757706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:44.758157 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:44.758973 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:44.759419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:44.839053 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] HTTP exception thrown: Invalid volume: volume deb290b6-8ddd-4121-b74b-02747c73ed29 is already attached to instances: d3124eb0-d33a-41bb-b18b-606e0e817e81 Jan 14 09:52:44.839669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Returning 400 to user: Invalid volume: volume deb290b6-8ddd-4121-b74b-02747c73ed29 is already attached to instances: d3124eb0-d33a-41bb-b18b-606e0e817e81 {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:52:44.840554 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-94587676-649b-4613-99ff-c3c17b4ede49 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094683 Jan 14 09:52:44.841112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 458/949] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:52:44 2022] POST /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 14 09:52:44.905041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:44.905532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:44.911652 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:44.912104 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:44.912907 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:44.913346 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:45.040293 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lazy-loading 'services' on Instance uuid d3124eb0-d33a-41bb-b18b-606e0e817e81 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:52:45.155145 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3139ef4e-41d2-4e06-9e18-acbe2d84ec2e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments/deb290b6-8ddd-4121-b74b-02747c73ed29" status: 202 len: 0 microversion: 2.1 time: 0.253464 Jan 14 09:52:45.155741 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 492/950] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:52:44 2022] DELETE /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments/deb290b6-8ddd-4121-b74b-02747c73ed29 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:52:45.164640 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:45.165969 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:45.173294 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:45.173802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:45.175183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:45.175620 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:45.207098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d95dcebb-fc45-4a3c-b76e-e31f6a13db8c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Jan 14 09:52:45.207098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 459/951] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:52:45 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:46.220047 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:46.220959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:46.227421 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:46.227871 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:46.228662 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:46.229105 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:46.258201 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-63671461-9d0b-4d48-bb87-a6c8d8fa2b84 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043019 Jan 14 09:52:46.258858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 493/952] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:52:46 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:52:46.419280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1213582727", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "746b6838-b16b-4837-950e-306ded637236"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:46.472012 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] validate_networks() for [('746b6838-b16b-4837-950e-306ded637236', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:52:46.856396 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:52:46.856744 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:52:46.857225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:52:46.857638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:52:46.858074 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:52:46.867690 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:46.868140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:46.868961 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:46.869423 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:46.885536 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:52:46.889608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for user f3c8ac9205954f4c80ecf83e0542ee9c and project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:52:46.900612 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:52:46.902954 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:52:46.947956 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-0bc13896-9845-4198-8963-68f05cacf0a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532368 Jan 14 09:52:46.948962 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 460/953] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 14 09:52:46.960442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9a49e6d3-4058-4079-9cc0-52d4dcd80de8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:46.961056 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9a49e6d3-4058-4079-9cc0-52d4dcd80de8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:47.014887 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9a49e6d3-4058-4079-9cc0-52d4dcd80de8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:47.023732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9a49e6d3-4058-4079-9cc0-52d4dcd80de8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1218 microversion: 2.1 time: 0.067034 Jan 14 09:52:47.024330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 494/954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:46 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:48.041501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:48.042124 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:48.049019 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:48.049980 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:48.050973 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:48.051472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:48.138009 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:48.145511 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f0f6054a-c10a-4f62-9180-da1db19ef858 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1276 microversion: 2.1 time: 0.108680 Jan 14 09:52:48.146091 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 461/955] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:48 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:49.161424 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:49.162117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:49.168558 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:49.169073 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:49.169856 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:49.170294 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:49.254046 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-6b452701-bd99-45ab-b3ce-7e3b3b59ae7f req-d45211d9-3ce6-4006-abe2-82eeb5f6a1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef44309e-5e2d-4892-9eb5-4db147171483", "tag": "e78aae1e-ce77-4220-a3bb-e0672cf22873"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:49.262890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:49.262890 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:49.272922 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6b452701-bd99-45ab-b3ce-7e3b3b59ae7f req-d45211d9-3ce6-4006-abe2-82eeb5f6a1f6 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:49.273827 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6b452701-bd99-45ab-b3ce-7e3b3b59ae7f req-d45211d9-3ce6-4006-abe2-82eeb5f6a1f6 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:49.287161 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-6b452701-bd99-45ab-b3ce-7e3b3b59ae7f req-d45211d9-3ce6-4006-abe2-82eeb5f6a1f6 service nova] Creating event network-changed:e78aae1e-ce77-4220-a3bb-e0672cf22873 for instance ef44309e-5e2d-4892-9eb5-4db147171483 on hv-cinder-82160 Jan 14 09:52:49.293129 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-6b452701-bd99-45ab-b3ce-7e3b3b59ae7f req-d45211d9-3ce6-4006-abe2-82eeb5f6a1f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045375 Jan 14 09:52:49.293906 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 462/956] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:52:49.328607 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:49.337066 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-233edac3-2cf7-462b-b8c0-4180b1f5372b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.179203 Jan 14 09:52:49.337787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 495/957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:49 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:50.353924 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:50.354656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:50.361190 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:50.361643 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:50.362469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:50.362989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:50.497195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:50.505396 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-08d00510-2433-4851-a740-d52df9eeb039 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.155527 Jan 14 09:52:50.505976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 463/958] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:50 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:51.521830 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:51.522458 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:51.528729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:51.529179 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:51.529955 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:51.530416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:51.664947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:51.671955 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-be15df2f-6f2e-439d-ad32-d268a01047a4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.153877 Jan 14 09:52:51.672538 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 496/959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:51 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:52.688803 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:52.689412 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:52.696468 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:52.696914 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:52.697680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:52.698113 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:52.826482 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:52.833869 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e1e725e7-34d4-44a0-a6f1-5f7b0efb2a26 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.148726 Jan 14 09:52:52.834478 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 464/960] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:52 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:52:53.850458 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:53.852324 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:53.859496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:53.860595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:53.861391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:53.861956 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:54.004353 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:54.011772 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4407aa57-5c15-41ae-b715-ebd0bd0aec1d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.165269 Jan 14 09:52:54.012345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 497/961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:53 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:54.949664 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-8098ce18-3af2-4c01-8c1d-636cb463debd req-52895726-4a3f-4bf5-9c31-e5106a21ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef44309e-5e2d-4892-9eb5-4db147171483", "name": "network-vif-plugged", "status": "completed", "tag": "e78aae1e-ce77-4220-a3bb-e0672cf22873"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:52:54.953635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:52:54.953635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:52:54.966294 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-8098ce18-3af2-4c01-8c1d-636cb463debd req-52895726-4a3f-4bf5-9c31-e5106a21ed1e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:54.966784 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-8098ce18-3af2-4c01-8c1d-636cb463debd req-52895726-4a3f-4bf5-9c31-e5106a21ed1e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:54.979834 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-8098ce18-3af2-4c01-8c1d-636cb463debd req-52895726-4a3f-4bf5-9c31-e5106a21ed1e service nova] Creating event network-vif-plugged:e78aae1e-ce77-4220-a3bb-e0672cf22873 for instance ef44309e-5e2d-4892-9eb5-4db147171483 on hv-cinder-82160 Jan 14 09:52:54.985460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-8098ce18-3af2-4c01-8c1d-636cb463debd req-52895726-4a3f-4bf5-9c31-e5106a21ed1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045377 Jan 14 09:52:54.986900 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 465/962] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:52:55.031700 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:55.032491 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:55.041513 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:55.042118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:55.043260 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:55.043895 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:55.333877 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:55.341285 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7ab81524-5a73-4aa9-85c0-31cb77beec8f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.315531 Jan 14 09:52:55.342176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 498/963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:55 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:56.357699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:56.358456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:56.365292 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:56.365852 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:56.366671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:56.367112 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:56.499420 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:56.506792 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d5bc403c-02db-49a4-b239-44fb33e40316 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.153481 Jan 14 09:52:56.507363 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 466/964] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:56 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:57.523343 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:57.523875 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:57.530084 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:57.530567 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:57.531345 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:57.531778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:57.660591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:57.667717 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fc429aa2-f74d-4759-804b-10bca7586f93 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.148153 Jan 14 09:52:57.668268 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 499/965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:57 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:58.684978 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:58.685622 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:58.692613 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:58.693065 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:58.693843 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:58.694281 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:58.825381 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:58.832616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-500346ee-fb34-435e-9633-257bbc154f5d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1318 microversion: 2.1 time: 0.151415 Jan 14 09:52:58.833186 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 467/966] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:58 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:52:59.848865 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:52:59.849480 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:52:59.855798 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:59.856254 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:59.857034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:52:59.857472 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:52:59.987734 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:52:59.995501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-63fd3d5e-8068-48f4-99bc-f598158ee24e tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1509 microversion: 2.1 time: 0.150326 Jan 14 09:52:59.996058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 500/967] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:52:59 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:01.295023 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee5333f-171a-428e-adc1-8708bc5e03eb"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:01.296073 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:01.302522 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:01.302976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:01.303759 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:01.304197 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:01.533642 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ef46a3bb-02d1-42b5-8b96-006ee98b84ac tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242119 Jan 14 09:53:01.534250 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 468/968] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:53:01 2022] POST /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:01.766416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:01.767002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:01.773905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:01.774525 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:01.775433 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:01.775875 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:01.804501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:53:01.890422 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c7867453-6c06-49d2-b27b-cea7f8f9d50a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 204 len: 0 microversion: 2.1 time: 0.127554 Jan 14 09:53:01.894183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 501/969] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:53:01 2022] DELETE /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:53:01.899874 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:01.900594 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:01.907723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:01.908103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:01.909440 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:01.909885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:02.069580 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:02.077527 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-133aa72e-3e43-4b02-9413-925d2381e8ca tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.181743 Jan 14 09:53:02.078160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 469/970] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:01 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:03.095041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:03.095751 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:03.102977 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:03.103435 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:03.104234 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:03.104682 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:03.242363 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:03.249774 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1a2ac42b-ca8d-4010-8184-810d7116dd06 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.158698 Jan 14 09:53:03.250340 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 502/971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:03 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:04.267101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:04.267722 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:04.275167 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:04.275612 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:04.276407 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:04.276838 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:04.416926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:04.425616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9df57bf7-1412-48fc-b961-bbaaa2a19900 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.162092 Jan 14 09:53:04.426172 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 470/972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:04 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:05.442673 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:05.443281 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:05.449864 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:05.450309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:05.451118 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:05.451553 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:05.587496 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:05.594845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-afbb7304-11d0-4262-9cbb-1489759e6d4b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.155943 Jan 14 09:53:05.595400 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 503/973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:05 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:06.612291 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:06.612898 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:06.619273 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:06.619754 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:06.620533 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:06.620965 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:06.752062 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:06.759999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d060339c-647f-4c90-b923-26c96311475d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.151460 Jan 14 09:53:06.760570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 471/974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:06 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:06.898009 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-0558214d-666e-476e-b79f-c428793c3e1b req-9517c608-f8b9-4b2b-9e52-ed3c69c1d94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56917cca-28b3-42a4-b9e3-b6b97a4b335b", "name": "network-vif-unplugged", "status": "completed", "tag": "4b264089-8f21-4f26-a3f0-1c2c4425bbdd"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:06.899602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:06.899602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:06.907041 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-0558214d-666e-476e-b79f-c428793c3e1b req-9517c608-f8b9-4b2b-9e52-ed3c69c1d94b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:06.907412 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-0558214d-666e-476e-b79f-c428793c3e1b req-9517c608-f8b9-4b2b-9e52-ed3c69c1d94b service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:06.918983 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-0558214d-666e-476e-b79f-c428793c3e1b req-9517c608-f8b9-4b2b-9e52-ed3c69c1d94b service nova] Creating event network-vif-unplugged:4b264089-8f21-4f26-a3f0-1c2c4425bbdd for instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b on hv-cinder-82160 Jan 14 09:53:06.923860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-0558214d-666e-476e-b79f-c428793c3e1b req-9517c608-f8b9-4b2b-9e52-ed3c69c1d94b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029517 Jan 14 09:53:06.924451 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 504/975] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:07.776513 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:07.777197 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:07.785870 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:07.786558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:07.787438 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:07.787928 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:07.945933 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:07.953487 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-96f86c4b-6a1b-4366-b40c-e6e126a9d88c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.180984 Jan 14 09:53:07.954061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 472/976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:07 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:08.980565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:08.983016 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:08.998286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:08.999664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:09.001439 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:09.002290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:09.197075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:09.208265 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cf2b7a17-00d9-46e5-bd44-7b8628fdf3b2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1576 microversion: 2.1 time: 0.234178 Jan 14 09:53:09.209120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 505/977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:08 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:10.109712 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-6a83b1ec-10ef-4df7-b1a5-37d4b7494a2c req-9fe69374-40a8-47e7-841e-3cdd92e673cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56917cca-28b3-42a4-b9e3-b6b97a4b335b", "name": "network-vif-deleted", "tag": "4b264089-8f21-4f26-a3f0-1c2c4425bbdd"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:10.112683 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:10.112683 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:53:10.129948 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6a83b1ec-10ef-4df7-b1a5-37d4b7494a2c req-9fe69374-40a8-47e7-841e-3cdd92e673cf service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.130721 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-6a83b1ec-10ef-4df7-b1a5-37d4b7494a2c req-9fe69374-40a8-47e7-841e-3cdd92e673cf service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.156857 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee5333f-171a-428e-adc1-8708bc5e03eb"}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:10.157928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:10.159510 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-6a83b1ec-10ef-4df7-b1a5-37d4b7494a2c req-9fe69374-40a8-47e7-841e-3cdd92e673cf service nova] Creating event network-vif-deleted:4b264089-8f21-4f26-a3f0-1c2c4425bbdd for instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b on hv-cinder-82160 Jan 14 09:53:10.167565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.168168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.169660 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.170130 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.176789 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-6a83b1ec-10ef-4df7-b1a5-37d4b7494a2c req-9fe69374-40a8-47e7-841e-3cdd92e673cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070584 Jan 14 09:53:10.179989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 473/978] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:10.229162 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:10.230706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:10.238141 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.238798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.239719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.240267 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.342903 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] HTTP exception thrown: Invalid volume: volume 2ee5333f-171a-428e-adc1-8708bc5e03eb is already attached to instances: ef44309e-5e2d-4892-9eb5-4db147171483 Jan 14 09:53:10.345287 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Returning 400 to user: Invalid volume: volume 2ee5333f-171a-428e-adc1-8708bc5e03eb is already attached to instances: ef44309e-5e2d-4892-9eb5-4db147171483 {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:53:10.348648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f44a2c4a-eec5-4855-9d7f-18ebe1c90165 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.195290 Jan 14 09:53:10.349765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 506/979] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:53:10 2022] POST /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 14 09:53:10.360986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:10.381985 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-d120d514-734f-446c-9cb3-51264b482fd6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 200 len: 1226 microversion: 2.1 time: 0.156707 Jan 14 09:53:10.383834 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 474/980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:10 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 1226 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:10.494257 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:10.495371 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:10.515658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.516739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.518965 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.519747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.662855 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lazy-loading 'services' on Instance uuid ef44309e-5e2d-4892-9eb5-4db147171483 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:53:10.763806 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-de0009d3-d3e3-4e4d-acc7-c55fc2b0db3a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments/2ee5333f-171a-428e-adc1-8708bc5e03eb" status: 202 len: 0 microversion: 2.1 time: 0.277788 Jan 14 09:53:10.765082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 507/981] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:53:10 2022] DELETE /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments/2ee5333f-171a-428e-adc1-8708bc5e03eb => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:53:10.775015 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:10.776718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:10.786110 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.787307 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.788772 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:10.789636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:10.845311 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-46f72a61-f5a3-4258-95d3-f78c35073ff7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074517 Jan 14 09:53:10.850440 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 475/982] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:53:10 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:53:11.418531 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:11.421612 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:11.436706 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:11.437943 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:11.442471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:11.443845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:11.472566 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] HTTP exception thrown: Instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b could not be found. Jan 14 09:53:11.474591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Returning 404 to user: Instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:53:11.476333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cd135cd3-33a2-4330-9d8f-479bb5175321 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 404 len: 111 microversion: 2.1 time: 0.068290 Jan 14 09:53:11.477665 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 508/983] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:11 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:53:11.657624 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1868795795", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1648902341", "security_groups": [{"name": "tempest-secgroup-smoke-38373261"}], "block_device_mapping_v2": [{"uuid": "3c71be79-73ab-41b6-9f48-c5fdf1b942d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80c10abc-4f06-43c3-8b66-e45b72fd3048"}]}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:11.811531 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.network.neutron [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] validate_networks() for [('80c10abc-4f06-43c3-8b66-e45b72fd3048', None, None, None, None, None)] {{(pid=128092) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:53:11.859532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:11.860524 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:11.867390 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:11.867835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:11.868818 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:11.869283 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:11.903521 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2e151cc8-d467-4be4-b38f-06ce199cef83 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048150 Jan 14 09:53:11.904226 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 509/984] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:53:11 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 14 09:53:12.090415 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1603669701", "imageRef": "3b19bbb8-7633-4d9d-aba2-e0711d30860c", "flavorRef": "452", "networks": [{"uuid": "746b6838-b16b-4837-950e-306ded637236"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:12.163019 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] validate_networks() for [('746b6838-b16b-4837-950e-306ded637236', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:53:12.254656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Flavor limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:53:12.255079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Image limits 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:53:12.255551 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Flavor pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:53:12.255959 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Image pref 0:0:0 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:53:12.256374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.virt.hardware [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:53:12.267433 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:12.268094 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:12.269029 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:12.269621 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:12.296227 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:53:12.304237 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.quota [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for user 1370e932bb594168b377811603f1b46f and project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'cores', 'instances', 'ram'} {{(pid=128092) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:53:12.372997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Going to run 1 instances... {{(pid=128092) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:53:12.375681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c71be79-73ab-41b6-9f48-c5fdf1b942d8',volume_size=None,volume_type=None)] {{(pid=128092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:53:12.522889 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-740ceef5-733f-4b81-b071-59713c5b3ab9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.868917 Jan 14 09:53:12.523542 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 476/985] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:53:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 14 09:53:12.541424 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c4eb2201-166e-46d1-abdd-69fedec7454d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:12.544196 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c4eb2201-166e-46d1-abdd-69fedec7454d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:12.612213 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:53:12.612787 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:53:12.613683 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:53:12.614536 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:53:12.615298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:53:12.623708 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c4eb2201-166e-46d1-abdd-69fedec7454d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:12.629698 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:12.630337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:12.631537 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:12.632218 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:12.634214 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c4eb2201-166e-46d1-abdd-69fedec7454d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1095 microversion: 2.1 time: 0.100612 Jan 14 09:53:12.634945 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 477/986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:12 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:12.664527 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:53:12.669266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Getting quotas for user f3c8ac9205954f4c80ecf83e0542ee9c and project 354e79c6a8ce495698e22aa2bc0c9566. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:53:12.687833 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:53:12.692062 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b19bbb8-7633-4d9d-aba2-e0711d30860c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:53:12.763530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-73f67237-9243-4cf5-afed-4d4bb6b87136 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675975 Jan 14 09:53:12.765028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 510/987] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 14 09:53:12.782656 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-08a1c613-1046-4a7a-b515-b8fc1d7eddc7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:12.784619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-08a1c613-1046-4a7a-b515-b8fc1d7eddc7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:12.868976 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-08a1c613-1046-4a7a-b515-b8fc1d7eddc7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:12.881246 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-08a1c613-1046-4a7a-b515-b8fc1d7eddc7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1218 microversion: 2.1 time: 0.106517 Jan 14 09:53:12.882295 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 478/988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:12 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:13.652209 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:13.652834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:13.660502 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:13.661085 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:13.662002 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:13.662782 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:13.729835 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:13.743872 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d2cd6331-be90-4c3b-ad13-b641d559897f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1193 microversion: 2.1 time: 0.095175 Jan 14 09:53:13.744966 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 511/989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:13 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:13.909841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:13.910802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:13.924520 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:13.927725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:13.930324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:13.931675 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:14.025671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:14.034452 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2f19adef-2e76-4a55-884a-a2296bfafad8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1270 microversion: 2.1 time: 0.131395 Jan 14 09:53:14.035347 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 479/990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:13 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:14.773951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:14.775411 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:14.783727 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:14.784313 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:14.785378 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:14.785927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:14.863370 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:14.874428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7bdf78e5-eecd-4fda-b645-07d12521f0be tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1199 microversion: 2.1 time: 0.107157 Jan 14 09:53:14.875272 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 512/991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:14 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:15.062324 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:15.067648 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:15.086563 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:15.087614 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:15.089394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:15.090504 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:15.498560 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:15.513630 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a4bc64b1-38ed-44d9-a1b8-7e40f0e6deb5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.455886 Jan 14 09:53:15.516048 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 480/992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:15 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:15.895122 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:15.896071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:15.902695 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:15.903156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:15.903979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:15.904424 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:16.073928 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:16.083173 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-238b1172-17da-429c-a248-5db9061b9f26 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.192112 Jan 14 09:53:16.083791 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 513/993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:15 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:16.534952 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:16.537570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:16.545908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:16.546652 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:16.547666 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:16.548288 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:16.898858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-1a3fa860-8eaa-448d-b90a-05b23dd27ac9 req-eba00fcf-d1e8-46df-9bc9-d5dcacdbab79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6896bc-b3f8-44b4-b814-e3a09b8ba68c", "tag": "e4a905e5-ffa5-4d99-82af-d3f47bad54f6"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:16.900551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:16.900551 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:16.912106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-1a3fa860-8eaa-448d-b90a-05b23dd27ac9 req-eba00fcf-d1e8-46df-9bc9-d5dcacdbab79 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:16.912876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-1a3fa860-8eaa-448d-b90a-05b23dd27ac9 req-eba00fcf-d1e8-46df-9bc9-d5dcacdbab79 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:16.940330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-1a3fa860-8eaa-448d-b90a-05b23dd27ac9 req-eba00fcf-d1e8-46df-9bc9-d5dcacdbab79 service nova] Creating event network-changed:e4a905e5-ffa5-4d99-82af-d3f47bad54f6 for instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c on hv-cinder-82160 Jan 14 09:53:16.951355 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-1a3fa860-8eaa-448d-b90a-05b23dd27ac9 req-eba00fcf-d1e8-46df-9bc9-d5dcacdbab79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055448 Jan 14 09:53:16.952838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 514/994] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:16.979088 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:16.987880 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6d9afded-0891-4329-8c21-2fefa95fceb4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.459211 Jan 14 09:53:16.989121 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 481/995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:16 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:17.103068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:17.104191 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:17.111269 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:17.111720 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:17.112530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:17.112959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:17.286629 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:17.295595 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-15ff2b47-6e53-4f06-b082-832e58ccf8bc tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.197484 Jan 14 09:53:17.296470 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 515/996] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:17 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:18.005188 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:18.005733 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:18.013548 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:18.013999 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:18.014823 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:18.015263 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:18.312891 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:18.313624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:18.320679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:18.321146 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:18.321944 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:18.322416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:18.350738 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:18.356628 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9d808a96-da51-4168-a255-721d41d93ec0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.355252 Jan 14 09:53:18.357210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 482/997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:18 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:18.481197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:18.489183 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c3482ddf-4de8-43b9-8ecf-36dd73d1a185 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.179954 Jan 14 09:53:18.489763 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 516/998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:18 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:18.968383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-93261426-cade-4261-a834-0db02ae629ff req-9a1b14aa-b3b1-4c99-8fc4-9d6e981ac0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cab3d16-15cb-4472-b795-e3fe98a7a981", "tag": "b6a7897c-484e-414e-a407-ab3798487654"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:18.970028 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:18.970028 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:53:18.977811 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-93261426-cade-4261-a834-0db02ae629ff req-9a1b14aa-b3b1-4c99-8fc4-9d6e981ac0a1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:18.978261 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-93261426-cade-4261-a834-0db02ae629ff req-9a1b14aa-b3b1-4c99-8fc4-9d6e981ac0a1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:18.989017 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-93261426-cade-4261-a834-0db02ae629ff req-9a1b14aa-b3b1-4c99-8fc4-9d6e981ac0a1 service nova] Creating event network-changed:b6a7897c-484e-414e-a407-ab3798487654 for instance 8cab3d16-15cb-4472-b795-e3fe98a7a981 on hv-cinder-82160 Jan 14 09:53:18.993841 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-93261426-cade-4261-a834-0db02ae629ff req-9a1b14aa-b3b1-4c99-8fc4-9d6e981ac0a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029114 Jan 14 09:53:18.994507 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 483/999] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:19.373071 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:19.373690 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:19.381075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:19.381535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:19.382333 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:19.382844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:19.507274 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:19.507967 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:19.513774 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:19.513947 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:19.514400 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:19.515164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:19.515596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:19.521082 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-75920222-30f2-4e52-841b-751fe08b1cd0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.151946 Jan 14 09:53:19.521651 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 517/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:19 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:19.645171 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:19.652581 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a04e95d6-05f4-486b-ac77-0302598766b5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.149671 Jan 14 09:53:19.653157 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 484/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:19 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:20.537971 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:20.538637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:20.544922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:20.545377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:20.546160 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:20.546629 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:20.669327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:20.669963 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:20.676741 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:20.678020 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:20.678892 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:20.679416 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:20.680245 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:20.688221 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9d96b6f4-2763-4f4a-a81b-d2d2c3daef5b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.153827 Jan 14 09:53:20.688807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 518/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:20 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:20.841955 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:20.849343 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-aa7b9e1d-a163-46a0-b2a4-0c0d6bc244dd tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.184067 Jan 14 09:53:20.849902 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 485/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:20 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:21.713968 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:21.714633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:21.721581 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:21.722030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:21.722851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:21.723286 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:21.857414 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:21.865677 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:21.866308 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:21.872389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4e98f3ae-b060-4e8f-913a-8363b1d0f36a tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.160944 Jan 14 09:53:21.872609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 519/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:21 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:21.873187 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:21.873649 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:21.874474 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:21.874929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:22.084330 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:22.092040 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c0ee296b-dc97-4174-acfa-ccca9d12d7ea tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.230028 Jan 14 09:53:22.093379 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 486/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:21 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:22.888608 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:22.889225 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:22.895718 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:22.896352 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:22.897467 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:22.898128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:23.032156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-5f3303b1-ccbd-4fee-93bf-ba97f026f096 req-cc3355ac-8f7c-4ceb-8598-c13ec3dd8de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cab3d16-15cb-4472-b795-e3fe98a7a981", "name": "network-vif-plugged", "status": "completed", "tag": "b6a7897c-484e-414e-a407-ab3798487654"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:23.035508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:23.035508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:53:23.035742 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:23.044572 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cf5993c6-21e2-42f6-8923-0869570b168c tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.159977 Jan 14 09:53:23.044737 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-5f3303b1-ccbd-4fee-93bf-ba97f026f096 req-cc3355ac-8f7c-4ceb-8598-c13ec3dd8de4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:23.045134 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-5f3303b1-ccbd-4fee-93bf-ba97f026f096 req-cc3355ac-8f7c-4ceb-8598-c13ec3dd8de4 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:23.053686 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 520/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:22 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:23.059030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-5f3303b1-ccbd-4fee-93bf-ba97f026f096 req-cc3355ac-8f7c-4ceb-8598-c13ec3dd8de4 service nova] Creating event network-vif-plugged:b6a7897c-484e-414e-a407-ab3798487654 for instance 8cab3d16-15cb-4472-b795-e3fe98a7a981 on hv-cinder-82160 Jan 14 09:53:23.064356 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-5f3303b1-ccbd-4fee-93bf-ba97f026f096 req-cc3355ac-8f7c-4ceb-8598-c13ec3dd8de4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036747 Jan 14 09:53:23.064957 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 487/1007] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:23.111948 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:23.113525 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:23.122309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:23.122917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:23.123802 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:23.124361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:23.261296 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:23.269600 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-64db49a5-d032-4482-ada2-960911a2ab17 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.164376 Jan 14 09:53:23.270189 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 521/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:23 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:24.062540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:24.063289 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:24.070195 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:24.070686 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:24.071545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:24.071972 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:24.215156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:24.225435 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-270377df-f88d-4c34-a235-7d092600451b tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1318 microversion: 2.1 time: 0.167651 Jan 14 09:53:24.235111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 488/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:24 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:24.287247 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:24.288092 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:24.296193 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:24.296739 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:24.297691 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:24.298339 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:24.500493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:24.513393 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5f9793ec-a32a-4be9-90fa-9bf8e2e4c313 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.230460 Jan 14 09:53:24.514590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 522/1010] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:24 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:25.242721 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:25.243585 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:25.250331 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:25.250816 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:25.252141 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:25.252589 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:25.397681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:25.406632 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c8d21592-51e8-4c11-9da3-ecbf0889b9a5 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1508 microversion: 2.1 time: 0.167529 Jan 14 09:53:25.408492 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 489/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:25 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:25.539347 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:25.540156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:25.546800 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:25.547257 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:25.548200 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:25.548649 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:25.968349 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:25.976348 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-8ba12049-f0d1-4fa0-952f-f9cf4f5a6a8a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.440594 Jan 14 09:53:25.976951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 523/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:25 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:26.787158 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b12381e6-1f6e-4984-b171-b6b5cff956d9"}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:26.788236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:26.794013 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:26.794499 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:26.795280 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:26.795723 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:27.002784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:27.003443 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:27.010388 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:27.010819 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:27.011886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:27.012326 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:27.055079 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9a051307-e5c0-494e-890d-73c4096bfb95 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "POST /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271178 Jan 14 09:53:27.056157 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 490/1013] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jan 14 09:53:26 2022] POST /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:27.091374 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-66c87321-5b44-43a7-94c1-f1be87b78df8 req-437a4c19-d650-4ec4-bda7-e9619f7b0677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6896bc-b3f8-44b4-b814-e3a09b8ba68c", "name": "network-vif-plugged", "status": "completed", "tag": "e4a905e5-ffa5-4d99-82af-d3f47bad54f6"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:27.093276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:27.093276 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:53:27.102948 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-66c87321-5b44-43a7-94c1-f1be87b78df8 req-437a4c19-d650-4ec4-bda7-e9619f7b0677 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:27.104166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-66c87321-5b44-43a7-94c1-f1be87b78df8 req-437a4c19-d650-4ec4-bda7-e9619f7b0677 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:27.120741 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-66c87321-5b44-43a7-94c1-f1be87b78df8 req-437a4c19-d650-4ec4-bda7-e9619f7b0677 service nova] Creating event network-vif-plugged:e4a905e5-ffa5-4d99-82af-d3f47bad54f6 for instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c on hv-cinder-82160 Jan 14 09:53:27.126778 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-66c87321-5b44-43a7-94c1-f1be87b78df8 req-437a4c19-d650-4ec4-bda7-e9619f7b0677 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042474 Jan 14 09:53:27.127919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 491/1014] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:27.191182 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:27.200220 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-5c043aca-7d12-404f-8024-3cc003da4f1c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.202469 Jan 14 09:53:27.200901 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 524/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:26 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:28.218964 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:28.219671 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:28.226718 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:28.227166 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:28.227989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:28.228437 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:28.368885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:28.381673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4283c29f-ceaf-46d6-8166-a714a848fa1e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1265 microversion: 2.1 time: 0.166914 Jan 14 09:53:28.382619 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 492/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:28 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:29.404731 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:29.405361 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:29.411932 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:29.412624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:29.413418 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:29.413859 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:29.555480 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:29.563205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-c48d1b8c-f774-4bdc-ac23-44a2f03ac408 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1451 microversion: 2.1 time: 0.161991 Jan 14 09:53:29.563825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 525/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:29 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:29.580245 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:29.580840 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:29.587218 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:29.587672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:29.588457 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:29.588896 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:29.731488 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:29.739540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-f50265d6-dd33-4a22-9dfb-ead2cef8a096 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1451 microversion: 2.1 time: 0.163098 Jan 14 09:53:29.740154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 493/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:29 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:31.525108 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-dd0dd357-1673-4dd5-a620-4f69baa07771 req-0f44593a-8b84-4529-b45a-1cc5792d8869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6896bc-b3f8-44b4-b814-e3a09b8ba68c", "tag": "e4a905e5-ffa5-4d99-82af-d3f47bad54f6"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:31.528309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:31.528309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:31.542035 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-dd0dd357-1673-4dd5-a620-4f69baa07771 req-0f44593a-8b84-4529-b45a-1cc5792d8869 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:31.542759 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-dd0dd357-1673-4dd5-a620-4f69baa07771 req-0f44593a-8b84-4529-b45a-1cc5792d8869 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:31.556186 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-dd0dd357-1673-4dd5-a620-4f69baa07771 req-0f44593a-8b84-4529-b45a-1cc5792d8869 service nova] Creating event network-changed:e4a905e5-ffa5-4d99-82af-d3f47bad54f6 for instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c on hv-cinder-82160 Jan 14 09:53:31.561216 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-dd0dd357-1673-4dd5-a620-4f69baa07771 req-0f44593a-8b84-4529-b45a-1cc5792d8869 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044241 Jan 14 09:53:31.561826 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 526/1019] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:34.686508 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:34.687016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:34.693894 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:34.694370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:34.695160 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:34.695597 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:34.771348 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lazy-loading 'services' on Instance uuid 8cab3d16-15cb-4472-b795-e3fe98a7a981 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:53:34.837491 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7a0bb379-b60f-4049-83c4-d83771c4e297 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments/b12381e6-1f6e-4984-b171-b6b5cff956d9" status: 202 len: 0 microversion: 2.1 time: 0.154630 Jan 14 09:53:34.838186 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 494/1020] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jan 14 09:53:34 2022] DELETE /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments/b12381e6-1f6e-4984-b171-b6b5cff956d9 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:53:34.852117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:34.853114 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:34.860171 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:34.861273 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:34.862068 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:34.862554 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:34.892360 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-248662c2-7f43-42e3-a7d9-072fc4dbc0e3 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 Jan 14 09:53:34.892906 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 527/1021] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:53:34 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:35.904813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:35.905860 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:35.912116 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:35.912570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:35.913349 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:35.913785 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:35.942816 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5b2b4538-6ba2-4ebf-9130-07c3e0095457 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042583 Jan 14 09:53:35.943369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 495/1022] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jan 14 09:53:35 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 14 09:53:37.118937 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:37.119435 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:37.125631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:37.126616 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:37.127395 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:37.127834 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:37.151890 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:53:37.224474 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-da50e902-5870-42c6-a794-70c3b1d4f0d8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 204 len: 0 microversion: 2.1 time: 0.108791 Jan 14 09:53:37.225058 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 528/1023] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:53:37 2022] DELETE /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:53:37.234140 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:37.234785 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:37.240836 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:37.241287 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:37.242165 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:37.242629 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:37.381210 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:37.389141 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-748a858c-3cfe-4ceb-b772-3dea84deb0c2 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1514 microversion: 2.1 time: 0.158569 Jan 14 09:53:37.389764 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 496/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:37 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:38.407998 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:38.408726 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:38.415030 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:38.415479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:38.416275 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:38.416707 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:38.564127 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:38.572087 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6407eb82-d08f-4dea-91d6-aa75a322ad96 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1514 microversion: 2.1 time: 0.168805 Jan 14 09:53:38.572679 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 529/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:38 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:39.589319 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:39.590098 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:39.599523 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:39.600131 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:39.600954 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:39.615026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:39.630896 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-7d4b3b7b-ad14-4dab-a0a5-f79fad37da4a req-ad4007cf-30c0-44d4-8b07-1a9aa765db1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cab3d16-15cb-4472-b795-e3fe98a7a981", "name": "network-vif-deleted", "tag": "b6a7897c-484e-414e-a407-ab3798487654"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:39.632522 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:39.632522 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:39.640010 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-7d4b3b7b-ad14-4dab-a0a5-f79fad37da4a req-ad4007cf-30c0-44d4-8b07-1a9aa765db1f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:39.640585 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-7d4b3b7b-ad14-4dab-a0a5-f79fad37da4a req-ad4007cf-30c0-44d4-8b07-1a9aa765db1f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:39.654800 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-7d4b3b7b-ad14-4dab-a0a5-f79fad37da4a req-ad4007cf-30c0-44d4-8b07-1a9aa765db1f service nova] Creating event network-vif-deleted:b6a7897c-484e-414e-a407-ab3798487654 for instance 8cab3d16-15cb-4472-b795-e3fe98a7a981 on hv-cinder-82160 Jan 14 09:53:39.660553 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-7d4b3b7b-ad14-4dab-a0a5-f79fad37da4a req-ad4007cf-30c0-44d4-8b07-1a9aa765db1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Jan 14 09:53:39.664565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 530/1026] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:53:39.711570 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:39.721143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-38934bf7-b79c-468e-bc09-5f1693524658 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 200 len: 1472 microversion: 2.1 time: 0.135097 Jan 14 09:53:39.722844 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 497/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:39 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 1472 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:40.739715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:40.740416 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 8cab3d16-15cb-4472-b795-e3fe98a7a981] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:40.747428 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:40.747878 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:40.748803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:40.749244 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:40.763861 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] HTTP exception thrown: Instance 8cab3d16-15cb-4472-b795-e3fe98a7a981 could not be found. Jan 14 09:53:40.764451 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Returning 404 to user: Instance 8cab3d16-15cb-4472-b795-e3fe98a7a981 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:53:40.765272 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-9198b04b-8993-464e-9c15-bffd49b060dd tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981" status: 404 len: 111 microversion: 2.1 time: 0.030212 Jan 14 09:53:40.765821 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 531/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:40 2022] GET /compute/v2.1/servers/8cab3d16-15cb-4472-b795-e3fe98a7a981 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:53:41.894304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:41.894813 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:41.901093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:41.901541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:41.902316 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:41.902771 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:41.928929 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:53:42.001282 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-816b1336-97ba-47cf-be76-e5bd65d68b5f tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 204 len: 0 microversion: 2.1 time: 0.110821 Jan 14 09:53:42.001993 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 498/1029] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:53:41 2022] DELETE /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:53:42.010228 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:42.010905 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:42.017672 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:42.018124 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:42.018932 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:42.019372 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:42.152097 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:42.159939 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-03d0e98a-4596-47a4-8f0e-d83be1fa5782 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1515 microversion: 2.1 time: 0.153542 Jan 14 09:53:42.160515 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 532/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:42 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:43.177833 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:43.178562 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:43.185265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:43.185715 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:43.186541 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:43.186982 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:43.328802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:43.336217 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6e535cc5-4bc9-42ea-84a2-844a024f5850 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1515 microversion: 2.1 time: 0.162975 Jan 14 09:53:43.336784 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 499/1031] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:43 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:44.129334 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-58f94ed4-fcfa-41c3-8c3f-7ec7ae5d1bb2 req-cc666340-19a6-4380-85e6-3a367001be25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef44309e-5e2d-4892-9eb5-4db147171483", "name": "network-vif-deleted", "tag": "e78aae1e-ce77-4220-a3bb-e0672cf22873"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:44.131315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:44.131315 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:44.140387 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-58f94ed4-fcfa-41c3-8c3f-7ec7ae5d1bb2 req-cc666340-19a6-4380-85e6-3a367001be25 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:44.141266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-58f94ed4-fcfa-41c3-8c3f-7ec7ae5d1bb2 req-cc666340-19a6-4380-85e6-3a367001be25 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:44.154870 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-58f94ed4-fcfa-41c3-8c3f-7ec7ae5d1bb2 req-cc666340-19a6-4380-85e6-3a367001be25 service nova] Creating event network-vif-deleted:e78aae1e-ce77-4220-a3bb-e0672cf22873 for instance ef44309e-5e2d-4892-9eb5-4db147171483 on hv-cinder-82160 Jan 14 09:53:44.169910 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-58f94ed4-fcfa-41c3-8c3f-7ec7ae5d1bb2 req-cc666340-19a6-4380-85e6-3a367001be25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Jan 14 09:53:44.169910 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 533/1032] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:44.352923 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:44.353520 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:44.360367 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:44.361434 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:44.362228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:44.362719 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:44.403270 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:44.403616 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:44.404070 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lazy-loading 'fault' on Instance uuid ef44309e-5e2d-4892-9eb5-4db147171483 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:53:44.444632 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:44.452115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ecc690b1-878f-4ebd-a0e8-b8889abff623 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 200 len: 1308 microversion: 2.1 time: 0.102932 Jan 14 09:53:44.452695 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 500/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:44 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:45.469075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:45.469820 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: ef44309e-5e2d-4892-9eb5-4db147171483] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:45.476331 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:45.476786 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:45.477591 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:45.478034 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:45.492321 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] HTTP exception thrown: Instance ef44309e-5e2d-4892-9eb5-4db147171483 could not be found. Jan 14 09:53:45.492907 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Returning 404 to user: Instance ef44309e-5e2d-4892-9eb5-4db147171483 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:53:45.493772 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-046337fe-3300-409a-a3ac-c3043e6c17d0 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483" status: 404 len: 111 microversion: 2.1 time: 0.029271 Jan 14 09:53:45.494321 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 534/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:45 2022] GET /compute/v2.1/servers/ef44309e-5e2d-4892-9eb5-4db147171483 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:53:45.502954 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:45.504047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:45.510093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:45.510596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:45.511416 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:45.511858 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:45.539811 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:53:45.616638 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e0856429-0a5a-4291-b95c-44a79751f10d tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 204 len: 0 microversion: 2.1 time: 0.117789 Jan 14 09:53:45.617659 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 501/1035] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:53:45 2022] DELETE /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 14 09:53:45.625336 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:45.626534 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:45.633877 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:45.634101 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:45.634845 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:45.635586 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:45.771873 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:45.780735 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a168fe22-a99a-411a-a6b6-bc819fc6d8b1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1513 microversion: 2.1 time: 0.159089 Jan 14 09:53:45.781501 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 535/1036] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:45 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:46.806122 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:46.806858 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:46.814096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:46.814739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:46.815908 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:46.816628 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:46.951392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:46.959472 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-75d32bcd-d18f-4d1b-a64a-1e88a19e83ef tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1513 microversion: 2.1 time: 0.157955 Jan 14 09:53:46.960049 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 502/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:46 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:53:47.542420 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-c724d6e4-617c-4dc8-9125-9e59fc020242 req-14ba41cf-2d5c-44e1-bdde-a0b2b850dcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1feb26-e8a4-4db8-b792-62b82c6b91d7", "name": "network-vif-deleted", "tag": "fb0fba0e-6ee7-4e18-8a0b-0bbd0399a47d"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:47.545722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:47.545722 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:47.560511 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c724d6e4-617c-4dc8-9125-9e59fc020242 req-14ba41cf-2d5c-44e1-bdde-a0b2b850dcac service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:47.561337 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-c724d6e4-617c-4dc8-9125-9e59fc020242 req-14ba41cf-2d5c-44e1-bdde-a0b2b850dcac service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:47.583021 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-c724d6e4-617c-4dc8-9125-9e59fc020242 req-14ba41cf-2d5c-44e1-bdde-a0b2b850dcac service nova] Creating event network-vif-deleted:fb0fba0e-6ee7-4e18-8a0b-0bbd0399a47d for instance 2d1feb26-e8a4-4db8-b792-62b82c6b91d7 on hv-cinder-82160 Jan 14 09:53:47.591291 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-c724d6e4-617c-4dc8-9125-9e59fc020242 req-14ba41cf-2d5c-44e1-bdde-a0b2b850dcac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055599 Jan 14 09:53:47.592520 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 536/1038] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:47.976627 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:47.977564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:47.983626 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:47.984078 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:47.984865 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:47.986275 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:48.021785 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:48.022226 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:48.022991 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lazy-loading 'fault' on Instance uuid 2d1feb26-e8a4-4db8-b792-62b82c6b91d7 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:53:48.061926 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:48.069369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c9950e4e-76b6-46e4-9d66-a86403fb30c7 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 200 len: 1307 microversion: 2.1 time: 0.096934 Jan 14 09:53:48.069970 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 503/1039] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:47 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:49.086651 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:49.087387 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: 2d1feb26-e8a4-4db8-b792-62b82c6b91d7] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:49.093590 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:49.094046 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:49.095391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:49.095833 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:49.109022 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] HTTP exception thrown: Instance 2d1feb26-e8a4-4db8-b792-62b82c6b91d7 could not be found. Jan 14 09:53:49.109614 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Returning 404 to user: Instance 2d1feb26-e8a4-4db8-b792-62b82c6b91d7 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:53:49.111023 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d0ff0e6c-04e5-4ddf-9ee1-d2a5696487a1 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7" status: 404 len: 111 microversion: 2.1 time: 0.028394 Jan 14 09:53:49.111579 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 537/1040] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:49 2022] GET /compute/v2.1/servers/2d1feb26-e8a4-4db8-b792-62b82c6b91d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:53:50.240896 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:50.241434 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:50.247702 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:50.248151 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:50.248942 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:50.249380 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:50.274765 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:53:50.353103 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-c4325d47-d779-4a87-97e6-3f39fb14b1e8 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 204 len: 0 microversion: 2.1 time: 0.115521 Jan 14 09:53:50.353930 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 504/1041] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:53:50 2022] DELETE /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:53:50.362812 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:50.363449 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:50.370203 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:50.370705 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:50.371599 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:50.371931 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:50.511197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:50.518747 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1832a3e8-3450-4b55-b622-346cf9a95d51 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1513 microversion: 2.1 time: 0.160290 Jan 14 09:53:50.519321 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 538/1042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:50 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:51.537606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:51.538308 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:51.544768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:51.545219 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:51.546001 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:51.546460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:51.688304 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:51.695986 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-84ae2321-028d-4aa5-bd06-0d56f7400554 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1513 microversion: 2.1 time: 0.162346 Jan 14 09:53:51.696564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 505/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:51 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:52.453824 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-f2350e6b-04c3-4c5b-8fbb-8cce81bd3d82 req-ebea0c5b-0ee5-4675-8eaf-68ca253bfa83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3124eb0-d33a-41bb-b18b-606e0e817e81", "name": "network-vif-deleted", "tag": "feb71080-4f0e-4bf7-99ba-b7cb1b3e3332"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:53:52.455625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:53:52.455625 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:53:52.463447 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-f2350e6b-04c3-4c5b-8fbb-8cce81bd3d82 req-ebea0c5b-0ee5-4675-8eaf-68ca253bfa83 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:52.463933 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-f2350e6b-04c3-4c5b-8fbb-8cce81bd3d82 req-ebea0c5b-0ee5-4675-8eaf-68ca253bfa83 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:52.475701 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-f2350e6b-04c3-4c5b-8fbb-8cce81bd3d82 req-ebea0c5b-0ee5-4675-8eaf-68ca253bfa83 service nova] Creating event network-vif-deleted:feb71080-4f0e-4bf7-99ba-b7cb1b3e3332 for instance d3124eb0-d33a-41bb-b18b-606e0e817e81 on hv-cinder-82160 Jan 14 09:53:52.480693 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-f2350e6b-04c3-4c5b-8fbb-8cce81bd3d82 req-ebea0c5b-0ee5-4675-8eaf-68ca253bfa83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 Jan 14 09:53:52.481291 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 539/1044] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:53:52.712849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:52.713467 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:52.719940 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:52.720393 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:52.721187 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:52.721646 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:52.755093 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:52.755566 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:52.756031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lazy-loading 'fault' on Instance uuid d3124eb0-d33a-41bb-b18b-606e0e817e81 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:53:52.799550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c8ac9205954f4c80ecf83e0542ee9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354e79c6a8ce495698e22aa2bc0c9566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:53:52.807349 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a9857356-a2e5-4f40-b4d7-1f6771971cbf tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 200 len: 1307 microversion: 2.1 time: 0.098188 Jan 14 09:53:52.807931 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 506/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:52 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:53:53.824850 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:53:53.825541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] [instance: d3124eb0-d33a-41bb-b18b-606e0e817e81] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:53:53.832375 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:53.832858 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:53.833647 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:53:53.834089 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:53:53.847494 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] HTTP exception thrown: Instance d3124eb0-d33a-41bb-b18b-606e0e817e81 could not be found. Jan 14 09:53:53.848086 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] Returning 404 to user: Instance d3124eb0-d33a-41bb-b18b-606e0e817e81 could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:53:53.848947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6ad46b24-5394-425d-b1ab-1297038fecf4 tempest-AttachVolumeNegativeTest-1643424546 tempest-AttachVolumeNegativeTest-1643424546-project] 10.222.0.48 "GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81" status: 404 len: 111 microversion: 2.1 time: 0.028577 Jan 14 09:53:53.849486 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 540/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:53:53 2022] GET /compute/v2.1/servers/d3124eb0-d33a-41bb-b18b-606e0e817e81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 14 09:54:26.816061 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 14 09:54:26.816577 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: Fri Jan 14 09:54:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 09:54:47.269724 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:54:47.270524 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:47.276383 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:47.276824 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:47.277595 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:47.278026 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:47.300301 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lazy-loading 'flavor' on Instance uuid 985c8e27-f3a6-4403-8aa8-687e5e8776a6 {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:54:47.381507 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-21712c73-726e-4d11-a94b-22e93d66f8ba tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "POST /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6/action" status: 202 len: 0 microversion: 2.1 time: 0.115384 Jan 14 09:54:47.382202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 507/1047] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:54:47 2022] POST /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:54:47.391838 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:47.392458 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:47.403624 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:47.404379 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:47.405707 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:47.406153 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:47.544298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:47.551688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-b775f6c0-5d32-4c11-be0d-50ebb6e8b22a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.163913 Jan 14 09:54:47.552248 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 541/1048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:47 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:54:48.571163 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:48.571859 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:48.578878 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:48.579322 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:48.580121 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:48.580556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:48.712443 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:48.720845 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-73550cef-f227-4a13-a8d1-f2126f5a9d75 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.153598 Jan 14 09:54:48.721680 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 508/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:48 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:49.737851 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:49.738515 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:49.744937 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:49.745385 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:49.746159 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:49.746623 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:49.875132 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:49.882437 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d77409b0-20e2-4d01-93dd-e16e81867ac6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.148217 Jan 14 09:54:49.883000 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 542/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:49 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:50.899600 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:50.900244 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:50.907137 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:50.907593 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:50.908384 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:50.908826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:51.038681 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:51.045917 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-a1752dd7-6c0c-4f2e-b6c5-c911e7d3abf5 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.149994 Jan 14 09:54:51.046506 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 509/1051] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:50 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:52.062859 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:52.063466 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:52.069756 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:52.070211 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:52.071022 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:52.071464 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:52.203656 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:52.211197 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f85a7f1c-26fd-4920-929f-75a0b856bece tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.151994 Jan 14 09:54:52.211766 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 543/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:52 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:53.228919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:53.230037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:53.236406 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:53.236855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:53.237632 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:53.238063 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:53.381989 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:53.393842 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-8477b440-751d-4ea8-aef7-cf2e0dbfcb5e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.168596 Jan 14 09:54:53.399913 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 510/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:53 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:54.411893 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:54.412668 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:54.419350 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:54.419795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:54.420633 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:54.421075 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:54.579600 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:54.587432 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f7811bf8-79df-44dd-9054-55df58857713 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.179373 Jan 14 09:54:54.588095 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 544/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:54 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:54:55.605058 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:55.605665 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:55.612288 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:55.612783 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:55.613683 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:55.614193 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:55.746820 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:55.754111 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5f1b5853-87c2-4f0e-8a8b-6b324ddf7ca0 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.152806 Jan 14 09:54:55.754717 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 511/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:55 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:56.772466 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:56.773015 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:56.779430 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:56.779927 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:56.780732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:56.781176 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:56.918857 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:56.927495 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6ec222fc-25f6-48bb-9abf-34eebdd2f75e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.158702 Jan 14 09:54:56.928073 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 545/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:56 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:57.945487 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:57.946101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:57.952958 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:57.953437 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:57.954236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:57.954699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:58.401674 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:58.412673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7c53dd7f-7fdf-44c1-a6bd-9c26c707e31b tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.471408 Jan 14 09:54:58.413251 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 512/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:57 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:54:59.430732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:54:59.431620 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:54:59.438886 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:59.439328 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:59.440147 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:54:59.440556 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:54:59.583442 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:54:59.591266 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2644c435-27ba-4fac-a421-6463f75e68a6 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.164423 Jan 14 09:54:59.591825 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 546/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:54:59 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:00.608924 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:00.609797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:00.616294 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:00.616798 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:00.617606 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:00.618016 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:00.768399 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:00.776583 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-871182f0-f61e-4870-814a-f092c90b550c tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1509 microversion: 2.1 time: 0.171380 Jan 14 09:55:00.777225 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 513/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:00 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:00.793826 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:00.794650 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:00.801143 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:00.801645 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:00.802502 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:00.802951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:00.886298 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-00a84cd1-d339-48ea-88bc-b763045d2cd3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "POST /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6/action" status: 202 len: 0 microversion: 2.1 time: 0.096957 Jan 14 09:55:00.886982 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 547/1060] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jan 14 09:55:00 2022] POST /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:55:00.895537 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:00.896563 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:00.904843 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:00.905534 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:00.906503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:00.907046 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:01.066695 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:01.075169 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-7dcd1a35-07e8-47a9-8bd2-b0325263f441 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1517 microversion: 2.1 time: 0.183567 Jan 14 09:55:01.075766 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 514/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:00 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:02.099081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:02.099846 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:02.106461 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:02.106930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:02.107732 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:02.108224 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:02.241915 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:02.250920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2abf7acd-9e78-491b-836d-9911a5bd06cf tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1519 microversion: 2.1 time: 0.156034 Jan 14 09:55:02.251429 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 548/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:02 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:55:03.268672 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:03.269271 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:03.275578 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:03.276024 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:03.276802 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:03.277236 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:03.413031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:03.423238 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-feccdec0-ae78-4cd8-aaeb-a6f5cc077c17 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1575 microversion: 2.1 time: 0.158201 Jan 14 09:55:03.423810 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 515/1063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:03 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:03.561823 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-28751fd5-c65e-483e-b01c-be53d6fc4403 req-59efafbb-606d-4fe8-9b51-fc880d2ccd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "name": "network-vif-unplugged", "status": "completed", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:03.564088 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:55:03.564088 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:55:03.572117 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-28751fd5-c65e-483e-b01c-be53d6fc4403 req-59efafbb-606d-4fe8-9b51-fc880d2ccd6d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:03.572571 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-28751fd5-c65e-483e-b01c-be53d6fc4403 req-59efafbb-606d-4fe8-9b51-fc880d2ccd6d service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:03.584318 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-28751fd5-c65e-483e-b01c-be53d6fc4403 req-59efafbb-606d-4fe8-9b51-fc880d2ccd6d service nova] Creating event network-vif-unplugged:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:55:03.589358 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-28751fd5-c65e-483e-b01c-be53d6fc4403 req-59efafbb-606d-4fe8-9b51-fc880d2ccd6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031333 Jan 14 09:55:03.590028 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 549/1064] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:55:04.440981 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:04.441596 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:04.448893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:04.449351 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:04.450156 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:04.450639 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:04.597023 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:04.604707 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-4a708473-4555-4fde-9c5e-aa6e84c0e59d tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1575 microversion: 2.1 time: 0.167382 Jan 14 09:55:04.605295 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 516/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:04 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:05.621930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:05.622664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:05.628676 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:05.629121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:05.629888 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:05.630329 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:05.764874 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:05.772441 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0c9e897e-21ef-424e-8934-9c766c0559fa tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1575 microversion: 2.1 time: 0.154945 Jan 14 09:55:05.773003 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 550/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:05 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:06.789576 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:06.790182 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:06.796141 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:06.796590 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:06.797371 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:06.797804 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:06.925894 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:06.934184 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-bba9c0ea-a553-4d3a-94c9-cdde70e15462 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1575 microversion: 2.1 time: 0.148332 Jan 14 09:55:06.934792 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 517/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:06 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:07.952662 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:07.953202 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:07.959479 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:07.959930 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:07.960715 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:07.961181 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:08.211889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:08.220246 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-fe2a5dcd-9763-4672-84b1-22d721b0c560 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1575 microversion: 2.1 time: 0.271993 Jan 14 09:55:08.220843 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 551/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:07 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:09.237378 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:09.237925 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:09.244768 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:09.245207 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:09.245984 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:09.246441 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:09.429950 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:09.438370 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2515bda4-7ee8-4e8c-9131-34059b7e962f tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1575 microversion: 2.1 time: 0.204721 Jan 14 09:55:09.439099 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 518/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:09 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:10.454935 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:10.455546 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:10.461782 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:10.462233 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:10.463688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:10.464125 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:10.591156 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:10.598386 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d709c798-4e50-4045-9f9a-27a0f77f81fe tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1562 microversion: 2.1 time: 0.147070 Jan 14 09:55:10.598949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 552/1070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:10 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:14.534202 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-235a3e7d-1aa2-4070-ada8-ce91545dc30a req-1aacdc5c-8b16-4b23-9144-5766629883ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "name": "network-vif-plugged", "status": "completed", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:14.535849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:55:14.535849 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:55:14.543939 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-235a3e7d-1aa2-4070-ada8-ce91545dc30a req-1aacdc5c-8b16-4b23-9144-5766629883ae service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:14.544386 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-235a3e7d-1aa2-4070-ada8-ce91545dc30a req-1aacdc5c-8b16-4b23-9144-5766629883ae service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:14.555556 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-235a3e7d-1aa2-4070-ada8-ce91545dc30a req-1aacdc5c-8b16-4b23-9144-5766629883ae service nova] Creating event network-vif-plugged:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:55:14.560402 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-235a3e7d-1aa2-4070-ada8-ce91545dc30a req-1aacdc5c-8b16-4b23-9144-5766629883ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 Jan 14 09:55:14.561139 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 519/1071] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:55:18.521990 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1063019606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1648902341", "security_groups": [{"name": "tempest-secgroup-smoke-38373261"}], "block_device_mapping_v2": [{"uuid": "fc25aa8b-821d-4628-aa1c-5c7a058205ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80c10abc-4f06-43c3-8b66-e45b72fd3048"}]}} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:18.636552 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.network.neutron [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] validate_networks() for [('80c10abc-4f06-43c3-8b66-e45b72fd3048', None, None, None, None, None)] {{(pid=128091) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 14 09:55:19.014766 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Flavor limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 14 09:55:19.015186 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Image limits 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 14 09:55:19.015694 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Flavor pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 14 09:55:19.016099 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Image pref 0:0:0 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 14 09:55:19.016535 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.virt.hardware [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 14 09:55:19.026064 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:19.026565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:19.027353 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:19.027782 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:19.045378 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 14 09:55:19.049593 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.quota [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Getting quotas for user 1370e932bb594168b377811603f1b46f and project bf5c8a2464f543e4b2e3c1a50648f73d. Resources: {'cores', 'instances', 'ram'} {{(pid=128091) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 14 09:55:19.103106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Going to run 1 instances... {{(pid=128091) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 14 09:55:19.105304 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc25aa8b-821d-4628-aa1c-5c7a058205ad',volume_size=None,volume_type=None)] {{(pid=128091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 14 09:55:19.224008 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-23a17261-5550-493c-823c-6685d4a74c67 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.705751 Jan 14 09:55:19.224634 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 553/1072] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jan 14 09:55:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 14 09:55:19.235110 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-10a805b6-c689-4ed4-baa5-c98f96e69ef4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:19.235806 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-10a805b6-c689-4ed4-baa5-c98f96e69ef4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:19.287002 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-10a805b6-c689-4ed4-baa5-c98f96e69ef4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:19.293564 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-10a805b6-c689-4ed4-baa5-c98f96e69ef4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1095 microversion: 2.1 time: 0.062834 Jan 14 09:55:19.294138 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 520/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:19 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:20.311391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:20.311391 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:20.318617 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:20.319070 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:20.320038 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:20.320530 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:20.391556 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:20.400677 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-7c36bba4-2f37-46fa-93f9-ffd3e003568c tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1211 microversion: 2.1 time: 0.094143 Jan 14 09:55:20.401386 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 554/1074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:20 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:21.417228 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:21.417965 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:21.427394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:21.428407 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:21.429548 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:21.430082 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:21.646699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:21.655242 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e05d4b6f-7a75-4b3a-aab6-ba6691d022b9 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.242023 Jan 14 09:55:21.655826 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 521/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:21 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:21.699807 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-adf4d977-37c0-4c7d-9c08-eec48447f2b5 req-657d63b3-2a80-4aa5-aaed-46257d4a248f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dbd088-4e3f-40bf-a1d8-6b4570ec964e", "tag": "3f628831-11b5-4805-bd1f-60bd89b47efd"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:21.708844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:55:21.708844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:55:21.716925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-adf4d977-37c0-4c7d-9c08-eec48447f2b5 req-657d63b3-2a80-4aa5-aaed-46257d4a248f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:21.717647 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-adf4d977-37c0-4c7d-9c08-eec48447f2b5 req-657d63b3-2a80-4aa5-aaed-46257d4a248f service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:21.734815 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-adf4d977-37c0-4c7d-9c08-eec48447f2b5 req-657d63b3-2a80-4aa5-aaed-46257d4a248f service nova] Creating event network-changed:3f628831-11b5-4805-bd1f-60bd89b47efd for instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e on hv-cinder-82160 Jan 14 09:55:21.741638 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-adf4d977-37c0-4c7d-9c08-eec48447f2b5 req-657d63b3-2a80-4aa5-aaed-46257d4a248f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045168 Jan 14 09:55:21.742996 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 555/1076] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:55:22.674977 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:22.675599 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:22.682255 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:22.683514 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:22.684332 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:22.684778 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:22.880827 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:22.889456 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-9d50c323-e9ea-45d5-add5-5d522f9e90b1 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.218103 Jan 14 09:55:22.890037 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 522/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:22 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:23.906678 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:23.907369 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:23.913565 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:23.913952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:23.914752 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:23.915185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:24.044506 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:24.051940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-43df59c0-8f4c-481b-83c6-04cea66550df tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.149251 Jan 14 09:55:24.052505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 556/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:23 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:24.169358 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 09:55:24.169615 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: Fri Jan 14 09:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 09:55:25.069138 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:25.069867 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:25.077177 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:25.077623 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:25.078420 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:25.078863 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:25.214788 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:25.222070 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-731ca7af-30d7-4a94-8dbd-dc71f5038240 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.156710 Jan 14 09:55:25.222669 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 523/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:25 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:26.239669 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:26.240309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:26.246917 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:26.247380 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:26.248184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:26.248637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:26.387377 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:26.395550 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-d86d5211-c4c7-4e59-89e7-aa3c4493ae04 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.159871 Jan 14 09:55:26.396123 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 557/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:26 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:27.413419 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:27.414208 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:27.421855 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:27.422294 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:27.423128 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:27.423558 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:27.562469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:27.569775 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-88b3a852-dc83-435b-b60e-9b66e1451563 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.160194 Jan 14 09:55:27.570340 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 524/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:27 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:55:28.586397 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:28.587024 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:28.593765 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:28.594217 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:28.595038 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:28.595471 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:28.729998 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:28.737526 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-2c53e29c-0f90-433f-b5ff-02cc8c38bf3f tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.154820 Jan 14 09:55:28.738094 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 558/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:28 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:29.753918 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:29.754660 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:29.762164 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:29.762653 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:29.763458 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:29.763907 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:29.906548 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:29.914108 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-3bff23f2-4c68-4758-8b9a-8f904d6ac602 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.163924 Jan 14 09:55:29.914635 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 525/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:29 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:30.931600 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:30.932210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:30.938803 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:30.939262 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:30.940054 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:30.940518 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:31.074795 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:31.082661 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-3bc92d94-d47c-446b-b770-b08a2a4afff3 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.155005 Jan 14 09:55:31.083236 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 559/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:30 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:55:31.791838 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-0061b829-f48d-4056-9c36-0b421e17252b req-1469fdda-e121-4594-93a9-423cd0ac8953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dbd088-4e3f-40bf-a1d8-6b4570ec964e", "name": "network-vif-plugged", "status": "completed", "tag": "3f628831-11b5-4805-bd1f-60bd89b47efd"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:31.793450 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:55:31.793450 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:55:31.801369 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-0061b829-f48d-4056-9c36-0b421e17252b req-1469fdda-e121-4594-93a9-423cd0ac8953 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:31.803035 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-0061b829-f48d-4056-9c36-0b421e17252b req-1469fdda-e121-4594-93a9-423cd0ac8953 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:31.816411 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-0061b829-f48d-4056-9c36-0b421e17252b req-1469fdda-e121-4594-93a9-423cd0ac8953 service nova] Creating event network-vif-plugged:3f628831-11b5-4805-bd1f-60bd89b47efd for instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e on hv-cinder-82160 Jan 14 09:55:31.821453 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-0061b829-f48d-4056-9c36-0b421e17252b req-1469fdda-e121-4594-93a9-423cd0ac8953 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Jan 14 09:55:31.822051 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 526/1085] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:55:32.100052 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:32.100667 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:32.107638 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:32.108205 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:32.109121 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:32.109531 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:32.246860 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:32.254090 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-cb9cd687-75c0-49b7-81fa-bb33914146b7 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1265 microversion: 2.1 time: 0.157626 Jan 14 09:55:32.254699 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 560/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:32 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:33.271799 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:33.273148 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:33.278725 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:33.279183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:33.279963 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:33.280402 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:33.412540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:33.422288 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-60f8da63-f226-414e-9f34-7f4c1887d1ec tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1451 microversion: 2.1 time: 0.154995 Jan 14 09:55:33.423801 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 527/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:33 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:33.438867 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:55:33.439486 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:55:33.445749 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:33.446199 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:33.447015 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:33.447458 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:33.581653 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:55:33.596954 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-f1907570-5914-4fe3-86f6-897afa4df921 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1451 microversion: 2.1 time: 0.161218 Jan 14 09:55:33.598033 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 561/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:55:33 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:55:35.586457 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-36fd6fe5-3f64-48b4-b97a-bfd949499bbc req-57147d54-7397-4c72-9768-46d22e74ee33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dbd088-4e3f-40bf-a1d8-6b4570ec964e", "tag": "3f628831-11b5-4805-bd1f-60bd89b47efd"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:55:35.587945 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:55:35.587945 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:55:35.595837 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-36fd6fe5-3f64-48b4-b97a-bfd949499bbc req-57147d54-7397-4c72-9768-46d22e74ee33 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:55:35.596289 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-36fd6fe5-3f64-48b4-b97a-bfd949499bbc req-57147d54-7397-4c72-9768-46d22e74ee33 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:55:35.607883 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-36fd6fe5-3f64-48b4-b97a-bfd949499bbc req-57147d54-7397-4c72-9768-46d22e74ee33 service nova] Creating event network-changed:3f628831-11b5-4805-bd1f-60bd89b47efd for instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e on hv-cinder-82160 Jan 14 09:55:35.613459 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-36fd6fe5-3f64-48b4-b97a-bfd949499bbc req-57147d54-7397-4c72-9768-46d22e74ee33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103160 Jan 14 09:55:35.614500 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 528/1089] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:56:27.289305 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-05fcbc04-d322-467f-89b6-39a97eca985b req-0f00c723-19ed-4c30-a0e4-ef8732133f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:56:27.291392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:56:27.291392 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:56:27.294011 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:56:27.294573 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:56:27.300975 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:27.301431 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:27.302517 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:27.302959 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:27.308584 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-05fcbc04-d322-467f-89b6-39a97eca985b req-0f00c723-19ed-4c30-a0e4-ef8732133f8e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:27.309368 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-05fcbc04-d322-467f-89b6-39a97eca985b req-0f00c723-19ed-4c30-a0e4-ef8732133f8e service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:27.323436 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-05fcbc04-d322-467f-89b6-39a97eca985b req-0f00c723-19ed-4c30-a0e4-ef8732133f8e service nova] Creating event network-changed:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:56:27.329862 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-05fcbc04-d322-467f-89b6-39a97eca985b req-0f00c723-19ed-4c30-a0e4-ef8732133f8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044875 Jan 14 09:56:27.330128 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Going to try to terminate instance {{(pid=128091) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:56:27.331442 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 529/1090] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:56:27.435192 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-88a89712-3c0e-41b5-874d-04918aadb58e tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "DELETE /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 204 len: 0 microversion: 2.1 time: 0.154620 Jan 14 09:56:27.436643 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 562/1091] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:56:27 2022] DELETE /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:56:27.445540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:56:27.446264 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:56:27.453791 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:27.454504 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:27.455096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:27.456987 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:27.745811 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:56:27.754706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-53d7dce6-dab8-413a-91da-34e0b198441a tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1568 microversion: 2.1 time: 0.313348 Jan 14 09:56:27.755485 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 530/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:56:27 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 14 09:56:28.776664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:56:28.777389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:56:28.783940 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:28.784393 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:28.785184 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:28.785626 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:28.927541 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:56:28.935610 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-6f1cf83f-53d5-41f0-9a88-e2cb9d2f9ac3 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1449 microversion: 2.1 time: 0.163110 Jan 14 09:56:28.936163 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 563/1093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:56:28 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:56:29.612540 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [req-318c76fa-a32f-4606-8a71-4cb4254890d7 req-d3dd3fa3-0bef-4e27-8560-9bb5b7b801d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c8e27-f3a6-4403-8aa8-687e5e8776a6", "name": "network-vif-deleted", "tag": "61ba2078-4848-49e0-ac0a-37d5d96adc46"}]} {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:56:29.614097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:56:29.614097 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: warnings.warn(msg) Jan 14 09:56:29.621244 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-318c76fa-a32f-4606-8a71-4cb4254890d7 req-d3dd3fa3-0bef-4e27-8560-9bb5b7b801d1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:29.621751 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [req-318c76fa-a32f-4606-8a71-4cb4254890d7 req-d3dd3fa3-0bef-4e27-8560-9bb5b7b801d1 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:29.633183 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.compute.server_external_events [req-318c76fa-a32f-4606-8a71-4cb4254890d7 req-d3dd3fa3-0bef-4e27-8560-9bb5b7b801d1 service nova] Creating event network-vif-deleted:61ba2078-4848-49e0-ac0a-37d5d96adc46 for instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 on hv-cinder-82160 Jan 14 09:56:29.638739 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [req-318c76fa-a32f-4606-8a71-4cb4254890d7 req-d3dd3fa3-0bef-4e27-8560-9bb5b7b801d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029667 Jan 14 09:56:29.639340 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 531/1094] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:56:29.953876 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:56:29.954665 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:56:29.962198 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:29.962769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:29.963612 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:29.964081 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:30.008126 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:30.008648 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:30.009778 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.objects.instance [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lazy-loading 'fault' on Instance uuid 985c8e27-f3a6-4403-8aa8-687e5e8776a6 {{(pid=128091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:56:30.050871 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77fc06f8ee40e3aec78fa5e7caf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac278870baf47c3b45b81d7e509466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:56:30.059269 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-1e90eb94-2b6a-4a3e-b546-b11936c256ef tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 200 len: 1223 microversion: 2.1 time: 0.109572 Jan 14 09:56:30.059856 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 564/1095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:56:29 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:56:31.077745 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:56:31.078482 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] [instance: 985c8e27-f3a6-4403-8aa8-687e5e8776a6] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:56:31.084658 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:31.085115 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:31.085905 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:56:31.086364 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:56:31.100886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] HTTP exception thrown: Instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 could not be found. Jan 14 09:56:31.101480 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Returning 404 to user: Instance 985c8e27-f3a6-4403-8aa8-687e5e8776a6 could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:56:31.102332 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-ba2b5705-5148-406b-8a4b-35e6d2b33ade tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6" status: 404 len: 111 microversion: 2.1 time: 0.029114 Jan 14 09:56:31.103408 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 532/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:56:31 2022] GET /compute/v2.1/servers/985c8e27-f3a6-4403-8aa8-687e5e8776a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:56:31.267793 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-4c800a75-dbab-482c-b511-5650b690b421 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] Calling method '.version_select at 0x7fd321b65280>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:56:31.290978 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-4c800a75-dbab-482c-b511-5650b690b421 tempest-TestShelveInstance-2063832462 tempest-TestShelveInstance-2063832462-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-524938077" status: 202 len: 0 microversion: 2.1 time: 0.026346 Jan 14 09:56:31.296012 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 565/1097] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jan 14 09:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-524938077 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:57:15.497503 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:15.498076 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:15.499972 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-de80b9ae-87c1-42e5-8c55-9b076ab43133 req-bbe5010b-2607-4c3a-910a-44bb0a3d1172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dbd088-4e3f-40bf-a1d8-6b4570ec964e", "tag": "3f628831-11b5-4805-bd1f-60bd89b47efd"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:57:15.501482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:57:15.501482 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:57:15.504030 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:15.504476 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:15.505265 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:15.505698 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:15.508988 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-de80b9ae-87c1-42e5-8c55-9b076ab43133 req-bbe5010b-2607-4c3a-910a-44bb0a3d1172 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:15.509438 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-de80b9ae-87c1-42e5-8c55-9b076ab43133 req-bbe5010b-2607-4c3a-910a-44bb0a3d1172 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:15.519882 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-de80b9ae-87c1-42e5-8c55-9b076ab43133 req-bbe5010b-2607-4c3a-910a-44bb0a3d1172 service nova] Creating event network-changed:3f628831-11b5-4805-bd1f-60bd89b47efd for instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e on hv-cinder-82160 Jan 14 09:57:15.525106 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-de80b9ae-87c1-42e5-8c55-9b076ab43133 req-bbe5010b-2607-4c3a-910a-44bb0a3d1172 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029876 Jan 14 09:57:15.525910 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 566/1098] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:57:15.532699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:57:15.616699 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-1ec4de9f-6b6b-4980-97b8-2c0cac704dd4 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 204 len: 0 microversion: 2.1 time: 0.123380 Jan 14 09:57:15.617655 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 533/1099] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:57:15 2022] DELETE /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:57:15.628330 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:15.629185 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:15.639290 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:15.639817 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:15.640688 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:15.641180 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:15.776969 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:57:15.784769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-0ed10e6f-0b22-4235-be65-bdd91ff09632 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1575 microversion: 2.1 time: 0.161620 Jan 14 09:57:15.785532 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 567/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:15 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:57:16.802873 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:16.803491 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:16.810464 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:16.810919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:16.811706 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:16.812151 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:16.942192 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:57:16.950015 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-e318f0ef-737f-44f2-bb4a-0a32750ae8a6 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1457 microversion: 2.1 time: 0.151599 Jan 14 09:57:16.950608 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 534/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:16 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1457 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:57:17.734584 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-28dc6bdb-a2ae-4ae1-9efc-ed8e1aa925f8 req-c2906d34-02a1-4fc8-a303-ba2c1bd30a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dbd088-4e3f-40bf-a1d8-6b4570ec964e", "name": "network-vif-deleted", "tag": "3f628831-11b5-4805-bd1f-60bd89b47efd"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:57:17.736210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:57:17.736210 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:57:17.743505 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-28dc6bdb-a2ae-4ae1-9efc-ed8e1aa925f8 req-c2906d34-02a1-4fc8-a303-ba2c1bd30a43 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:17.743952 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-28dc6bdb-a2ae-4ae1-9efc-ed8e1aa925f8 req-c2906d34-02a1-4fc8-a303-ba2c1bd30a43 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:17.754841 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-28dc6bdb-a2ae-4ae1-9efc-ed8e1aa925f8 req-c2906d34-02a1-4fc8-a303-ba2c1bd30a43 service nova] Creating event network-vif-deleted:3f628831-11b5-4805-bd1f-60bd89b47efd for instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e on hv-cinder-82160 Jan 14 09:57:17.760056 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-28dc6bdb-a2ae-4ae1-9efc-ed8e1aa925f8 req-c2906d34-02a1-4fc8-a303-ba2c1bd30a43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204173 Jan 14 09:57:17.760637 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 568/1102] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:57:17.967045 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:17.967759 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:17.974241 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:17.974678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:17.975460 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:17.975921 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:18.005437 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:18.005886 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:18.006335 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lazy-loading 'fault' on Instance uuid d7dbd088-4e3f-40bf-a1d8-6b4570ec964e {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:57:18.045431 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:57:18.053898 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-5fcd00a7-452b-46d2-8d75-b8f1ff24a777 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 200 len: 1231 microversion: 2.1 time: 0.090682 Jan 14 09:57:18.054639 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 535/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:17 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:57:19.072235 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:19.072922 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: d7dbd088-4e3f-40bf-a1d8-6b4570ec964e] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:19.078951 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:19.079401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:19.080167 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:19.080602 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:19.094920 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] HTTP exception thrown: Instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e could not be found. Jan 14 09:57:19.095493 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Returning 404 to user: Instance d7dbd088-4e3f-40bf-a1d8-6b4570ec964e could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:57:19.096297 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-483241ba-9e55-468f-955f-d77c80a8b227 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e" status: 404 len: 111 microversion: 2.1 time: 0.028512 Jan 14 09:57:19.096806 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 569/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:19 2022] GET /compute/v2.1/servers/d7dbd088-4e3f-40bf-a1d8-6b4570ec964e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:57:22.152550 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:22.153105 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:22.154134 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-08352c79-5631-42a5-8d47-c1fabd5b8bfe req-2f2d3c88-0acd-4642-80b7-ce1816b17142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6896bc-b3f8-44b4-b814-e3a09b8ba68c", "tag": "e4a905e5-ffa5-4d99-82af-d3f47bad54f6"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:57:22.155664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:57:22.155664 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:57:22.159394 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:22.159942 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:22.160799 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:22.161309 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:22.163658 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-08352c79-5631-42a5-8d47-c1fabd5b8bfe req-2f2d3c88-0acd-4642-80b7-ce1816b17142 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:22.164113 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-08352c79-5631-42a5-8d47-c1fabd5b8bfe req-2f2d3c88-0acd-4642-80b7-ce1816b17142 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:22.175365 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-08352c79-5631-42a5-8d47-c1fabd5b8bfe req-2f2d3c88-0acd-4642-80b7-ce1816b17142 service nova] Creating event network-changed:e4a905e5-ffa5-4d99-82af-d3f47bad54f6 for instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c on hv-cinder-82160 Jan 14 09:57:22.181063 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-08352c79-5631-42a5-8d47-c1fabd5b8bfe req-2f2d3c88-0acd-4642-80b7-ce1816b17142 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031051 Jan 14 09:57:22.181995 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 570/1105] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 14 09:57:22.188154 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Going to try to terminate instance {{(pid=128092) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 14 09:57:22.276492 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-2ed097e9-30f1-4378-8a61-94c1bb20773e tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 204 len: 0 microversion: 2.1 time: 0.128788 Jan 14 09:57:22.277797 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 536/1106] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:57:22 2022] DELETE /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 14 09:57:22.286771 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:22.287844 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:22.294144 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:22.294744 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:22.295627 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:22.296240 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:22.455025 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.policy [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128091) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:57:22.463781 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-a4f97d29-7f2c-44cb-9879-d597f0737e6b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1576 microversion: 2.1 time: 0.181380 Jan 14 09:57:22.464769 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 571/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:22 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:57:23.482663 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:23.483354 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:23.490207 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:23.490678 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:23.491449 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:23.491885 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:23.626560 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:57:23.634469 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-738b2708-305f-4ed4-ad0e-eaa292f23f11 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1457 microversion: 2.1 time: 0.155829 Jan 14 09:57:23.635031 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 537/1108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:23 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:57:24.220457 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [req-cb06cf6e-9c3c-4608-b72f-e144f28ca70a req-11c1eb08-0610-4225-aae6-36b6e1a09a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6896bc-b3f8-44b4-b814-e3a09b8ba68c", "name": "network-vif-deleted", "tag": "e4a905e5-ffa5-4d99-82af-d3f47bad54f6"}]} {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 14 09:57:24.222401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 14 09:57:24.222401 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: warnings.warn(msg) Jan 14 09:57:24.230309 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-cb06cf6e-9c3c-4608-b72f-e144f28ca70a req-11c1eb08-0610-4225-aae6-36b6e1a09a41 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:24.230784 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [req-cb06cf6e-9c3c-4608-b72f-e144f28ca70a req-11c1eb08-0610-4225-aae6-36b6e1a09a41 service nova] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:24.242383 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.compute.server_external_events [req-cb06cf6e-9c3c-4608-b72f-e144f28ca70a req-11c1eb08-0610-4225-aae6-36b6e1a09a41 service nova] Creating event network-vif-deleted:e4a905e5-ffa5-4d99-82af-d3f47bad54f6 for instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c on hv-cinder-82160 Jan 14 09:57:24.247801 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [req-cb06cf6e-9c3c-4608-b72f-e144f28ca70a req-11c1eb08-0610-4225-aae6-36b6e1a09a41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 Jan 14 09:57:24.248389 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 572/1109] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jan 14 09:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 14 09:57:24.650835 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:24.651484 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:24.658101 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:24.658586 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:24.659365 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:24.659830 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:24.690047 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:24.690545 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:24.690997 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.objects.instance [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lazy-loading 'fault' on Instance uuid 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c {{(pid=128092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 14 09:57:24.729946 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.policy [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1370e932bb594168b377811603f1b46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5c8a2464f543e4b2e3c1a50648f73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128092) authorize /opt/stack/nova/nova/policy.py:199}} Jan 14 09:57:24.738096 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-81746928-1368-4e9f-b719-e13e4ba2b96b tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 200 len: 1231 microversion: 2.1 time: 0.090873 Jan 14 09:57:24.738697 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 538/1110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:24 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 14 09:57:25.757250 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:25.757949 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:25.764556 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:25.765005 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:25.765790 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:25.766231 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:25.780703 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] HTTP exception thrown: Instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c could not be found. Jan 14 09:57:25.781292 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Returning 404 to user: Instance 2d6896bc-b3f8-44b4-b814-e3a09b8ba68c could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:57:25.782120 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-e849a784-42ea-4418-aae6-20b19cce7f3a tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c" status: 404 len: 111 microversion: 2.1 time: 0.029308 Jan 14 09:57:25.782693 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 573/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:25 2022] GET /compute/v2.1/servers/2d6896bc-b3f8-44b4-b814-e3a09b8ba68c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:57:26.224175 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:26.224673 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.compute.api [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128092) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:26.231084 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:26.231587 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:26.232315 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:26.232747 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG oslo_concurrency.lockutils [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:26.247318 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.wsgi [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] HTTP exception thrown: Instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b could not be found. Jan 14 09:57:26.247903 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Returning 404 to user: Instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b could not be found. {{(pid=128092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:57:26.248721 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-75db1bc7-600c-4645-810b-8a91f0bb3ad2 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 404 len: 111 microversion: 2.1 time: 0.028216 Jan 14 09:57:26.249259 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 539/1112] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jan 14 09:57:26 2022] DELETE /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:57:26.257365 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '>' {{(pid=128091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:26.257979 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.compute.api [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [instance: 56917cca-28b3-42a4-b9e3-b6b97a4b335b] Fetching instance by UUID {{(pid=128091) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 14 09:57:26.264499 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:26.264947 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:26.265729 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 14 09:57:26.266168 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG oslo_concurrency.lockutils [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Lock "26554650-9bca-4ac8-ac00-b49e5e3ee01d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 14 09:57:26.279671 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.wsgi [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] HTTP exception thrown: Instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b could not be found. Jan 14 09:57:26.280280 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: DEBUG nova.api.openstack.wsgi [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Returning 404 to user: Instance 56917cca-28b3-42a4-b9e3-b6b97a4b335b could not be found. {{(pid=128091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 14 09:57:26.281097 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO nova.api.openstack.requestlog [None req-256430a2-e409-402b-93bd-ec904d1aac6d tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b" status: 404 len: 111 microversion: 2.1 time: 0.027445 Jan 14 09:57:26.281631 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: [pid: 128091|app: 0|req: 574/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jan 14 09:57:26 2022] GET /compute/v2.1/servers/56917cca-28b3-42a4-b9e3-b6b97a4b335b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 14 09:57:27.574636 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: DEBUG nova.api.openstack.wsgi [None req-6529c3d3-c1d4-4e9c-aa8d-1f155282faa5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] Calling method '.version_select at 0x7fd322b97ca0>' {{(pid=128092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 14 09:57:27.577909 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6529c3d3-c1d4-4e9c-aa8d-1f155282faa5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [58151807-e0c2-4fac-a8c8-f69c88de416e] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 14 09:57:28.585467 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO oslo.messaging._drivers.impl_rabbit [None req-6529c3d3-c1d4-4e9c-aa8d-1f155282faa5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] [58151807-e0c2-4fac-a8c8-f69c88de416e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55386. Jan 14 09:57:28.604327 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO nova.api.openstack.requestlog [None req-6529c3d3-c1d4-4e9c-aa8d-1f155282faa5 tempest-TestVolumeBootPattern-925021366 tempest-TestVolumeBootPattern-925021366-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1648902341" status: 202 len: 0 microversion: 2.1 time: 1.033409 Jan 14 09:57:28.604893 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: [pid: 128092|app: 0|req: 540/1114] 10.222.0.48 () {58 vars in 1262 bytes} [Fri Jan 14 09:57:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1648902341 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 14 09:58:30.640817 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 09:58:30.641501 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: Fri Jan 14 09:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 10:00:25.039143 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 10:00:25.039919 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: Fri Jan 14 10:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 10:00:35.141267 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 10:00:35.141889 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: Fri Jan 14 10:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 10:00:39.847376 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 10:00:39.847925 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: Fri Jan 14 10:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 10:01:50.649038 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 10:01:50.649651 dv-cinder-821602-11-iscsi devstack@n-api.service[128092]: Fri Jan 14 10:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 14 10:02:04.181971 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 14 10:02:04.182609 dv-cinder-821602-11-iscsi devstack@n-api.service[128091]: Fri Jan 14 10:02:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!